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Item  20  (Continued) 

Behavioral  and  social  scientists  have  tended  to  rely  heavily  on 
statistical  analyses,  because  of  their  substantial  applicability  to  be- 
havioral and  social  science  problems.  However,  there  are  certain  basic 
limitations  in  applying  statistical  methods  to  these  problem  areas. 
Statistics  cannot  be  used  to  describe  formally  the  system  of  relationships 
within  a class  of  phenomena.  Statistical  techniques  can  indicate  levels 
of  interactions  among  variables,  but  they  cannot  be  used  to  depict  the 
form  or  quality  of  these  interactions. 

Algebraic  theory  contains  concepts  and  principles  which  can  be  used 
to  articulate  the  structural  properties  of  classes  of  behavioral  phenomena. 
It  refers  to  the  study  of  classes  of  behavioral  rule  systems,  each  of  which 
has  a set  of  elements,  operation(s)  defined  on  the  set,  and  rules  deter- 
mining certain  interrelationships  among  elements  and  operations. 

Algebra  provides  a language  which  is  precise,  intuitive,  and  formal. 
Algebraic  systems  have  been  used  to  synthesize  separate  models  and  theories. 
Synthesis  of  the  proliferation  of  seemingly  disparate  and  expanding  bodies 
of  behavioral  science  knowledge  is  greatly  needed.  Alqebra  as  a field  can 
become  as  useful  to  the  behavioral  and  social  scientist  as  statistics.  Its 
utility  will  be  most  evident  in  the  activities  of  description  and  conceptu- 
alization. Au  in  the  case  with  statisti'-s,  the  use  of  algebra  does  not 
require  any  substantive  theoretical  commitments. 

In  this  book,  a variety  of  uses  of  algebra  in  the  behavioral  and  social 
sciences  is  provided  along  with  descriptions  of  several  algebraic  systems. 
This  volume  is  intended  to  be  a sourcebook  for  theoretical  conceptualiza- 
tions for  professionals  in  the  behavioral  and  social  sciences.  This  publi- 
cation with  its  emphasis  on  description,  application,  and  utility  should 
be  a valuable  aid  to  the  behavioral  and  social  science  researcher.  ^ 

This  book  is  presented  in  eight  chapters.  The  first  four  chapters 
present  the  foundational  material  on  algebraic  concepts  and  should  be  read 
before  attempting  to  examine  the  remaining  chapters.  The  following  para- 
graphs provide  a brief  summary  of  the  content  of  each  chapter. 

In  chapter  l the  basic  terminology  and  elementary  concepts  of  set 
theory  are  introduced.  The  discussion  presupposes  no  knowledge  of  mathe- 
matics; the  explanations  are  presented  in  a quite  thorough,  yet  highly  in- 
tuitive manner.  Ample  examples  are  presented,  many  of  them  having  direct 
psychological  relevance. 

We  all  have  an  intuitive  idea  of  what  is  meant  by  a "relation."  A 
relation  reflects  some  type  of  association  or  connection  between  two  en- 
tities. In  order  to  be  more  precise  in  describing  this  vague  idea  ot  a 
bond  between  entities,  a mathematical  formulation  of  a relation  is  needed. 
Chapter  2 serves  this  function. 

One  of  the  most  important  ideas  in  all  of  mathematics  is  that  of  a 
function  or  mapping.  This  term  is  so  fundamental  that  it  is  commonly  used 
in  most  disciplines.  Chapter  3 defines  and  discusses  the  role  of  functions 
in  algebraic  systems. 
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Item  20  (Continued) 

A class  of  alqebraic  entities  useful  in  psychology  is  groups.  The 
presentation  on  groups  will  be  made  in  chapters  4 and  5.  Chapter  4 in- 
cludes a discussion  of  the  definition  of  a group  and  other  related  terms. 
Other  key  terms  such  as  subgroups,  generators,  homorphisms,  isomorphisms, 
and  semigroups  are  introduced.  The  chapter  concludes  with  examples  of 
several  important  types  of  groups. 

Chapter  5 is  concerned  with  the  application  of  groups  to  psychology. 
Examples  are  given  from  Piagetian  theory,  the  theory  of  kinship  relations, 
studies  of  measurement,  perception,  language,  and  automata  theory. 

Chapter  6 introduces  rings  and  fields.  It  is  a relatively  short  chap- 
ter, because  presently  there  are  very  few  applications  of  these  concepts 
to  psychology.  Their  applicability  has  not  really  been  tested  yet.  In 
this  chapter  imtortant  terminology  is  defined  and  illustrated  through 
example (s) . 

Chapter  7 introduces  another  major  algebraic  system.  A vector  space 
has  structural  similarities  to  the  other  systems  already  considered,  but 
introduces  a new  operation.  The  value  of  particular  vector  spaces  in 
statistical  and  measurement  analysis  of  psychological  phenomena  has  been 
recognized.  Many  of  these  techniques  are  based  on  vector  space  theory. 

The  examination  of  vector  spaces  proceeds  in  two  parts.  Chapter  7 intro- 
duces the  concept  and  discusses  linear  combinations,  linear  independence 
and  dependence  and  bases. 

Chapter  8 is  directed  at  the  concept  of  a matrix.  The  matrix  is  an 
excellent  concept  to  conclude  the  book  with,  because  it  will  be  proved  that 
the  set  of  matrices  may  be  used  in  defining  a group,  or  ring,  or  a vector 
space,  or  under  certain  special  conditions,  in  defining  a field.  This  will 
serve  as  a review  of  the  key  structures  introduced  in  the  book.  Matrices 
also  are  valuable  to  discuss  because  they  have  a wide  range  of  applications 
outside  of  mathematics. 
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PREFACE 


In  dealing  with  Army  problems  over  the  years  the  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  has  always  insisted 
on  bringing  to  bear  a scientific  point  of  view.  This  point  of  view 
includes  objectivity,  use  of  theoretical  models  and  their  resulting 
hypotheses,  reliance  on  empirical  data  rather  than  armchair  estimates, 
and  use  of  mathematical  and  statistical  methods  of  analysis.  In  par- 
ticular the  Institute  has  drawn  heavily  upon  the  formal  systems  and 
methods  found  in  the  disciplines  of  psychometrics,  statistics,  linear 
algebra,  probability  theory,  and  operations  research. 

The  current  volume  presents  for  behavioral  scientists,  both  inside 
and  outside  of  the  Army,  an  introduction  to  another  set  of  mathematical 
systems  with  potentially  interesting  applications.  These  systems, 
often  referred  to  as  "modern  algebra"  and  here  called  "algebraic  sys- 
tems, ” have  potential,  not  so  much  for  pun*>ses  of  data  analysis,  but 
rather  for  describing  formally  the  system  of  relationships  within  a 
class  of  phenomena.  As  is  typical  of  mathematical  systems,  the  ideas 
and  structures  presented  here  have  great  power  and  generality.  They 
could  well  be  useful  in  constructing  models  of  social  and  behavioral 
phenomena . 

Jj.  Jj, 

J.  J.  MELLINGER 
Chief,  Research  Statistics 
and  Computer  Science  Office 


J.  E.  UHL  AN  01 

Technical  Director,  ARI  and 
Chief  Psychologist,  U.S.  Army 
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ALGEBRAIC  SYSTEMS:  APPLICATIONS  IN  THE 
BEHAVIORAL  AND  SOCIAL  SCIENCES 


INTRODUCTION 

This  book  is  an  introduction  to  the  uses  of  the  branch  of  mathe- 
matics called  algebra  in  the  behavioral  sciences.  Basically,  there 
are  three  branches  of  mathematics — geometry,  analysis,  and  algebra. 
Geometry  is  the  field  concerned  with  the  properties  and  relationships 
of  points,  lines,  angles,  surfaces,  and  solids.  Analysis  is  the  field 
concerned  with  functions  and  limits  and  includes  the  calculus.  Algebra 
is  the  field  concerned  with  sets  that  have  sums  and/or  products  defined 
on  their  elements  and  includes  arithmetic  and  set  theory.  As  opposed 
to  the  preconceived  views  of  many  behavioral  scientists,  algebra  is  not 
merely  the  study  of  polynomials  as  a remembrance  of  high  school  algebra 
could  effect.  Of  the  three  branches  of  mathematics,  algebra  is  the 
most  abstract  and  foundational  branch. 

Each  of  those  branches  has  been  found  to  have  substantial  utility. 
Geometry  is  a very  useful  field  to  architects  and  civil  engineers. 
Analysis  is  probably  the  branch  of  mathematics  that  is  used  the  most 
and  this  is  reflected  in  the  fact  that  training  in  the  calculus  is  re- 
quired for  an  education  in  practically  every  scientific  and  engineering 
area.  Algebra,  though  being  the  most  abstract  branch  of  mathematics, 
has  manifested  its  utility  to  the  sciences  in  a variety  of  ways.  For 
example,  the  algebraic  theory  of  groups  has  been  very  useful  to  theo- 
retical physicists  in  their  formulation  of  quantum  mechanics  and  Boolean 
algebra  has  been  crucial  to  computer  science  theorists  in  their  exposi- 
tion of  digital  circuit  theory.  What  is  to  be  indicated  is  that  al- 
gebra has  a host  of  important  uses  in  the  behavioral  sciences. 

It  may  seem  strange  to  one  interested  in  the  behavioral  sciences 
that  being  acquainted  with  algebra  would  be  an  aid  in  his  work.  He  may 
think  that  he  studied  algebra  in  high  school  and  it  was  found  to  be 
useful  in  determining  roots  of  quadratic  equations  and  the  like  but  it 
certainly  is  not  the  methodological  tool  chest  that  statistics  is  for 
research  in  the  behavioral  sciences.  So  why  study,  of  all  things, 
algebra? 

Well,  statistics  is  a field  which  has  substantial  applicability 
to  the  behavioral  sciences.  However,  it  does  have  limitations.  Statis- 
tics cannot  be  used  to  describe  formally  the  system  of  relationships 
within  a class  of  phenomena  in  a manner  that  is  as  exacting  and  rich 
as  algebra  can.  Though  statistical  techniques  can  be  used  to  indicate 
the  level  of  interaction  of  two  or  more  variables,  they  cannot  be  used 
to  depict  the  form  or  quality  of  that  interaction.  On  the  other  hand, 
within  the  corpus  of  algebra  there  is  a rich  reservoir  of  concepts 
and  principles  which  can  be  used  to  articulate  the  structural  proper- 
ties of  classes  of  behavioral  phenomena  as  it  refers  to  the  study  of  a 
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wide  class  of  rule-systems,  each  of  which  has  a set  of  elements,  op- 
eration (s)  defined  on  the  set,  and  rules  determining  certain  interre- 
lationships among  elements  and  operations.  Also  this  branch  of 
mathematics  is  laden  with  concepts  and  principles  as  it  is  centuries 
old  and  has  grown  at  an  extraordinary  rate  in  this  century. 

A property  of  algebra  that  is  often  over  looked  is  that  it  is  quite 
natural.  Much  of  our  everyday  thinking  is  in  conformance  with  algebraic 
principles.  To  a great  extent,  algebra  is  a rigorous  articulation  and 
logical  extension  of  patterns  of  reasoning  that  are  common  to  people. 

For  example,  much  of  set  theory  is  merely  a formal  exposition  of  modes 
of  mental  organization  that  are  evidenced  in  everyday  life.  Thus,  be- 
havioral scientists  may  rightly  view  algebra  not  as  an  exotic,  arbi- 
trary, abstruse  field  but  as  a field  which  provides  a meaningful  dis- 
cussion of  patterns  that  are  very  immediate,  common,  and  even  obvious. 

There  is  another  quality  of  alqebra  that  should  be  of  interest  to 
behavioral  science  devotees.  Algebra,  especially  with  the  development 
of  algebraic  logic,  provides  a language  which  is  very  precise,  primi- 
tive, and  rich,  and  nearly  perfect  in  its  lucidity.  Such  a precise 
language  should  be  of  use  to  behavioral  scientists. 

Another  property  of  algebra  relates  to  one  of  its  primary  uses 
in  mathematics.  Elements  of  algebra  such  as  its  constituent  systems 
and  structures  have  been  used  to  tie  parts  of  mathematics  together  and 
to  show  how  different  entities  in  mathematics  are  interconnected  and 
related.  In  other  words,  algebra  has  had  and  will  continue  to  have  a 
decisive  synthesizing  effect  on  the  proliferating  corpus  of  mathematics. 
Presently,  the  algebraic  theory  of  categories  is  being  used  in  this 
regard  to  depict  the  forms  of  integration  amidst  mathematical  systems. 

It  is  contended  that  algebra,  when  applied  properly,  would  have  a simi- 
lar influence  in  the  behavioral  sciences.  Needless  to  say,  synthesis 
is  greatly  needed  in  the  behavioral  sciences  as  most  of  the  research  in 
the  behavioral  sciences  is  directed  to  experimental  analyses  of  theories 
and  models  and  this  emphasis  on  analysis  has  resulted  in  a proliferation 
of  seemingly  disparate  and  expanding  bodies  of  behavioral  science 
knowledge.  For  example,  there  is  a variety  of  psychologies  of  school 
learning  that  have  resulted  in  a multitude  of  empirical  studies,  many 
of  which  remain  trivial  and  disconnected.  With  synthesis,  more  direc- 
tion will  be  provided  to  allow  for  more  research  in  the  behavioral 
sciences . 

Algebra  is  a field  that  should  become  as  useful  a field  as  statis- 
tics is  to  the  behavioral  scientist.  Its  greatest  utility  will  be  evi- 
dent in  the  activities  of  description  and  conceptualization  in  the  be- 
havioral sciences.  As  is  the  case  with  statistics,  the  use  of  algebra 
does  not  require  any  substantive  theoretical  commitments.  Thus,  in 
the  area  of  psychology,  algebra  should  be  as  potentially  useful  in  the 
areas  of  operant  conditioning  or  associationistic  psychology  as  it  would 
be  in  the  areas  of  cognitive  developmental  psychology  from  a Piagetian 
viewpoint. 
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Already  important  uses  of  algebra  in  the  behavioral  sciences  have 
been  made.  For  example,  Jean  Piaget,  a noted  pioneer  in  developmental 
psychology,  has  employed  the  algebraic  theory  of  lattices  to  describe 
the  system  of  cognitive  processes  propter  to  adolescence.  Also,  Noam 
Chomsky,  seminal  thinker  in  the  psychology  of  language,  has  used  al- 
gebraic concepts  and  principles  to  articulate  the  structural  proper- 
ties of  grammars  which  refer  to  the  systems  underlying  human  linguistic 
capabilities. 

In  this  book,  a variety  of  uses  of  algebra  in  the  behavioral  sci- 
ences is  provided  along  with  descriptions  of  several  algebraic  systems. 
This  volume  is  intended  to  be  a sourcebook  for  theoretical  conceptuali- 
zations for  students  and  professionals  in  the  behavioral  sciences. 

With  the  use  of  algebra,  the  physical  sciences  have  made  consid- 
erable progress — much  more  than  the  behavioral  sciences.  It  is  likely 
that  the  behavioral  sciences  can  also  make  profound  progress  if  it 
makes  greater  use  of  algebra.  This  volume  with  its  emphasis  on  de- 


scription and  utility  should  be  an  aid  in  that  endeavor  to  behavioral 
science  students  and  professionals. 


CHAPTER  1 


SET  THEORY 


In  this  chapter  the  basic  terminology  and  elementary  notions  of 
set  theory  are  introduced.  The  discussion  presupposes  no  knowledge  of 
mathematics;  the  explanations  will  be  presented  in  a quite  thorough, 
yet  highly  intuitive  manner.  This  discussion  is  not  a rigorous  study 
of  axiomatic  set  theory,  but  rather  a concise  overview  of  a very  ele- 
gant theory.  There  will  be  an  ample  number  of  exanqples,  many  of  them 
psychologically  relevant,  to  assist  the  reader  in  his  understanding 
of  what  may  at  first  be  rather  abstract  material. 

The  idea  basic  to  the  entire  text  will  be  that  of  a set.  The  no- 
tion of  a set  will  not  be  formally  defined,  but  will  be  taken  to  mean 
any  collection  of  entities,  objects,  or  stimuli.  These  objects  may 
have  some  common  property,  such  as  each  object  in  a collection  of  ob- 
jects is  red,  or  there  may  be  no  apparent  mutuality  among  the  items. 

The  individual  objects  belonging  to  the  given  set  will  be  called  ele- 
ments . For  example,  a red  triangle  would  be  an  element  in  a collection 
of  red  objects.  A convention  that  will  be  adhered  to  throughout  the 
book  is  to  denote  sets  by  capital  letters,  and  use  lower  case  letters 
to  represent  elements.  If  an  element,  x,  belongs  to  a set  A,  we  write 
x £ A.  If  x does  not  belong  to  A,  then  we  write  x /£  A.  Suppose  r 
represents  a red  triangle,  s denotes  a silver  circle,  and  R is  the  set 
of  all  red  objects,  then  r £ R,  but  s if  R.  The  set  consisting  of  no 
elements  is  called  the  null  set  and  is  denoted  by  . An  example  would 
be  the  set  of  all  triangles  with  360°. 


We  may  indicate  a set  by  listing  all  of  its  elements.  In  the  case 
of  infinite  sets  this  is  impossible,  and  often  it  is  also  inconvenient 
to  list  all  the  elements  in  a large  finite  set.  In  this  case  we  use 
what  is  called  the  set  builder  notation.  The  following  examples  illus- 
trate the  situation. 


Examples 

If  A consists  of  the  numbers  1,2, 3, 4,  and  5,  then  A may  be  written 
as  A = {1,2, 3, 4, 5}. 


If  B equals  all  the  counting  (natural)  numbers  from  one  to  one 
hundred , then  B may  be  denoted  as  B = {1,2,3,..., 100 } , or  equiva- 
lently, B = {n|n  is  a natural  number  and  lent  100},  which  is 
read  "B  equals  the  set  of  all  n,  such  that  n is  a natural  number 
and  1 is  less  than  or  equal  to  n and  also  n is  less  than  or  equal 
to  100." 


fRBCSUNO  FifOE 


3.  If  C - (Connecticut,  Rhode  Island,  Mas  achusetts,  Vermont,  New 
Hampshire,  Maine},  then  C may  be  more  concisely  represented  as 
C = (x|x  is  a New  England  state). 

4.  Suppose  D = (signal  learning,  S-R  learning,  chaining,  ve.rbal  as- 
sociation, multiple  discrimination,  concept  learning,  principle 
(rule)  learning,  problem  solving).  A person  familiar  with  Gagne's 

work  would  describe  D by  sayinq  D = (xlx  e • , 

- . . , ] u ixlx  is  one  of  the  eiqht  tvoes 

of  learning  described  by  Gagne}.  y 

In  order  to  make  comparisons  between  sets,  we  must  first  define 
the  equality  of  two  sets.  Two  sets  A and  B are  equal  if  and  only  if 
whenever  *(  A,  then  x C B,  and  conversely  whenever  x € B,  then  x € A 
i.e.,  when  the  two  sets  consist  of  the  same  elements.  The  set  consist- 
ing of  Hubert  Humphrey  and  Walter  Mondale  is  equal  to  the  set  of  United 
States  Senators  from  Minnesota,  because  both  sets  have  exactly  the  same 
members  A is  a subset  of  B if  every  element  in  A is  also  an  element 
of  B.  This  is  denoted  by  A C B or  equivalently  B^  A.  A is  a proper 
subset  of  B if  every  element  in  A is  in  B and  there  exist  additl^Tl  " 
elements  in  B not  in  A.  This  is  equivalent  to  A C B and  A / B.  We 
write  this  as  A $ B.  The  set  of  states  consisting  of  Vermont  and  Maine 
is  a proper  subset  of  the  New  England  states.  The  reader  should  note 
at  a second  form  of  notation  is  also  widely  used.  We  could  write 
_ B to  represent  A is  a subset  of  B,  and  write  A C B to  represent  A 
is  a proper  subset  of  B.  Therefore,  it  is  important  to  check  which  no- 
tation is  being  used  in  the  text  which  is  being  read.  Returning  to 
our  discussion,  we  see  that  we  have  an  alternative  definition  for  the 
equality  of  sets  A and  B.  We  may  define  A = B if  and  only  if  AC  B 
and  B C A. 


Examples 

1.  Let  E = The  set  of  fifty  states  in  the  United  States 
= (x|x  is  a state  in  the  United  States}; 

let  F = {all  states  in  the  United  States  having  a location  with 
an  elevation  of  at  least  3000  feet}. 

Then  we  may  conclude  that  F C E,  and  more  specifically  that  F c E, 
because  there  exist  states  with  highest  elevation  less  than  3000 
feet,  e.g.,  New  Jersey.  We  have  Colorado  € F,  New  York  € F,  and 
California  £ F.  Hence,  we  could  define  a set  G as  G = (Colorado, 
New  York,  California},  where  G $ F.  But,  for  example,  if  H = 
(Colorado,  New  Jersey  , then  H <£  F even  though  H £ E.  One  final 
related  example  is  designed  to  illustrate  that  a set  of  one  element 
is  not  identical  with  that  element.  We  can  speak  of  Colorado  in 
two  ways,  Colorado  £ E,  or  (Colorado)  $.  E.  in  the  first  case  we 
are  talking  about  Colorado  as  an  element  of  the  set  E;  in  the  second 
case  we  are  talking  about  Colorado  as  a set  of  one  element  which  is 
included  in  but  not  equal  to  the  set  E. 
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2. 


A more  mathematical  example  is  the  following: 


Define  B = {1/2}; 

R - {positive  multiples  of  3}  = {3,6,9,...}; 

A = {positive  multiples  of  2}  = {2 ,4 ,6 ,8 , . . . } ; 

I = {even  natural  numbers}  = {2 , 4 ,6,8, . . . } ; and 

N = {natural  numbers}. 

Clearly,  R,  A,  and  I are  proper  subsets  of  N.  Also,  observe  that 
A = I since  both  sets  have  the  same  elements.  A <f.  R because,  for 
example,  4 4-  R,  also  R <t-  A since  3 4-  A.  Therefore,  it  is  often  the 
case  that  when  considering  two  sets,  neither  set  is  a subset  of 
the  other.  It  is  also  interesting  to  notice  that  B <t~  N.  This  is 
an  illustration  where  a set  with  infinitely  many  elements,  such  as 
A,  is  a subset  of  N and  where  sets  with  one  element,  such  as  B, 
are  not  a subset  of  N. 


Basic  Operations 

Set  theory  would  be  of  little  worth  if  there  were  no  ways  of  form- 
ing new  sets  from  the  given  ones.  We  will  define  several  operations  on 
sets.  The  definitions  will  be  for  two  sets,  but  they  can  be  easily 
generalized  to  any  finite  number  or  an  infinite  number  of  sets. 

Definition  1.  The  intersection  of  two  sets,  A and  B,  denoted 
A O B,  is  the  set  consisting  of  those  elements  belonging  to  both  A and 
B.  Symbolically,  this  may  be  expressed  as 

AC\  B = {x|x  £ A and  x C B}. 


Two  sets,  A and  B,  are  said  to  be  disjoint  or  mutually  exclusive  if 
A ^ B = cf) . 

We  may  generalize  this  definition.  For  three  sets,  C,  D,  E, 

C ''1  D ''h  E = {x|x€C  and  x £ D and  x £ E};  and 

for  N sets,  A^ , A ,...,A^, 

N 

O A.  = {x|x  € A.  for  every  i;  i = 1,2,...,N} 
i=l  1 1 

= axo  a2o  ...oAjj. 

The  intersection  of  two  sets  A and  B may  be  pictorially  represented  by 
Venn  diagrams  as  illustrated  in  Figure  1. 
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Fiqure  1 


Examples 

In  discussions  of  psychological  space,  two  stimuli  are  often  con- 
sidered to  have  a psychological  distance  between  them.  If  the  di- 
mension of  color,  shape,  and  size  are  involved,  whore  color  is 
black  or  white,  shape  is  triangle  or  square,  and  size  is  small  or 
large,  then  if 

□ - {white,  square,  large); 

H - {black,  square,  small);  and 


D •«  {white,  square,  small); 


it  may  be  observed  that 


| jand  □ 


are  closer  than 


O 


terms  of  psychological  space,  because  they  differ  on  only  the  dimen- 
sion of  size,  i.e.,  their  intersection  shows  a common  color  and 
shape.  Therefore,  any  discussion  of  psychological  distance  between 
stimuli  implies  an  understanding  of  the  intersection  operation. 

Another  illustration  is  in  considering  similarity  between  words. 
Suppose  in  a free  association  test,  the  sub)ect  is  told  to  give 
five  associations  to  words  A,  B,  and  C.  If  A and  B have  four  com- 
mon words,  p and  C have  two  common  words,  and  A and  C have  one 
common  word,  then  this  would  be  one  index  of  claiming  there  is 
greatest  similarity  between  A and  B.  Notice  that  the  consideration 
of  commonality  implicitly  requires  the  use  of  the  intersection 
operation. 


Definition  2.  The  union  of  two  sets,  A and  B,  is  the  set  consist- 
ing of  olements  belonging  to  A or  to  B or  to  both  A and  B.  It  is  de- 
noted by  A U B,  with  AU  B - (x|xC  A or  xC  Bor  xC  A and  B).  The 
word  "or"  will  be  taken  to  include  the  possibility  of  membership  in 
both  sets.  Thus,  "or"  will  be  interpreted  in  an  inclusive  manner. 

The  union  operation  is  pictorially  described  in  Fiqure  2. 


B 


A » I x|x  4 A}. 


Examp 1 e 

1.  In  an  experiment  with  100  subjects,  50  individuals  receive  treat- 
ment A,  and  the  remaining  50  subjects  form  the  control  qroup.  We 
may  think  of  the  100  subjects  as. being  the  universal  set  V,  the  50 
individuals  receiving  treatment  A as  set  A,  and  those  in  the  con- 
trol group  as  A. 


Definition  4.  The  difference  of  A and  B,  denoted  A - B,  is  the  set 
consisting  of  those  elements  belonging  to  A and  not  belonging  to  B. 

This  operation  is  pictorially  described  in  Figure  4. 


A-B={x|x€a  and  x { B I 

is  the  set  notational  definition  for  the  difference  operation.  Clearly, 
we  may  say  that  A - B *=  A O IT. 


Example 

1.  The  newspaper  carries  an  advertisement  that  there  is  a job  availa- 
ble for  a person  with  a B.A.  in  psychology  and  specifies  that  the 
person  must  be  under  30.  If  p represents  all  those  individuals 
with  a B.A.  in  psychology,  and  T denotes  all  those  people  30  years 
old  and  over,  then  P - T consists  of  those  individuals  who  meet 
the  minimal  qualifications  for  employment. 


Definition  5.  The  symmetric  difference  of  A and  B is  defined  to 
be  those  elements  in  A,  but  not  in  B or  those  elements  in  B,  but  not 
in  A.  Figure  5 is  a Venn  diagram  for  the  symmetric  difference  of  A 
and  B. 
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A A B 


A A B = (x|x  £ A and  x f B or  x C B and  x ^ A } . 


Therefore, 


A A B = (A  - B)  U (B  - A)  . 


Example 

1.  In  conditioning  experiments  a pigeon  is  rewarded  if  he  pecks  a key 
and  is  punished  if  he  does  not.  Therefore,  key  pecking  and  punish- 
ment never  go  together.  If  K denotes  the  times  a pigeon  pecked 
the  key,  and  P represents  the  times  the  pigeon  was  punished,  then 
K A P would  describe  the  principle  involved  in  conditioning,  i.e., 
if  the  pigeon  pecks  the  key  he  is  not  punished  and  if  he  is  punished 
he  did  not  peck  the  key. 

As  a means  of  reviewing  and  interrelating  the  five  definitions  just 
given,  an  example  with  sets  of  numbers  is  included. 


Examples 

1.  Let  "IT  = {1,2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15), 

A - {2,4,6,8,10,12,14}; 

B = {1,6,11}; 

C = {3,6,9,12,15}. 

Then,  we  have 

A (1  B =*  {6}; 

BU  C = {1,3,6,9,11,12,15); 

A - {1,3,5,7,9,11,13,15}; 

AH  (BUC)  - {2,3,6,8,10,12,14)0  {1,3,6,9,11,12,15)  - {6,12}; 

A - B - AO  B - {2,4,6,8,10,12,14)0  {2 , 3, 4 ,5 , 7 ,8 ,9, 10, 12 , 13, 14 , 1 5 1 
- {2,4,8,10,12,14); 

B A C - (B  - C)  U (C  - B)  - {1,11)  U {3,9,12,15)  - {1,3,9,11,12,15). 
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2.  With  the  1976  presidential  election  approaching  there  is  much  con- 
jecture as  to  whom  the  Democratic  Party  will  nominate.  In  deter- 
mining who  the  nominee  will  be,  each  candidate  will  be  weighed  as 
to  his  strengths  and  weaknesses  on  various  personal  qualities, 
political  views,  electability , etc.  It  would  be  an  interesting 
exercise  to  define  or  compile  a list  of  criteria  most  desirable  to 
you.  Then  derive  a rating  system  involving  union,  intersection, 
and  complementation  to  evaluate  each  contender,  and  see  if  your 
personal  choice  and  your  highest  rated  individual  are  the  same 
person. 

In  order  to  aid  the  reader  in  his  understanding  of  the  set  theo- 
retic terminology,  several  elementary  proofs  using  the  new  abstract 
language  are  included.  The  analogy  to  learning  a language  is  a mean- 
ingful one,  because  for  a person  to  really  understand  a word,  he  must 
be  able  to  use  it  in  appropriate  situations.  The  following  proofs 
serve  a similar  purpose  for  the  words,  intersection,  union,  complemen- 
tation, difference,  and  symmetric  difference. 


Proofs 


1.  AC  B if  and  only  if  A B = A. 

Proof:  One  must  first  realize  that  an  "if  and  only  if"  proof  re- 
quires two  proofs.  We  must  show  that  A C B implies  that 
AO  B = A,  and  also  that  if  AO  B » A,  then  AC  B.  As  an 
aid  in  the  proof,  draw  a Venn  diagram  similar  to  the  one 
in  Figure  6. 


Figure  6 


In  proving  results  such  as  this  one,  accompanying  pictures 
may  aid  in  visualizing  the  problem,  but  one  must  realize 
that  even  if  a picture's  intuitive  worth  may  be  a thousand 
words,  it  is  not  a formal  proof.  With  this  thought  in  mind 
we  begin  the  proof. 

a . Suppose  A C B . 

(i)  Let  x € A,  then  by  hypothesis  x£  B,  and  we  have  x€  A 
and  xC.  B.  Therefore,  we  have  xC  A O B,  but  xC  A im- 
plying x£  A ft  B is  precisely  AC  A O B. 
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(ii)  Let  x C AO  B,  then  we  have  x C A and  x C B,  but  in  par- 
ticular xC  A.  Hence,  xC  AO  b implies  x£  A,  or  equiva- 
lently A r\  B C A. 

Combining  (i)  and  (ii)  , AC  AO  B and  AO  BC  A,  yield  that 
AH  B - A,  which  is  the  desired  result. 

b.  Suppose  A O B « A. 

If  AO  B - A,  we  may  say  that  A C A O B.  Further,  by  the 
definition  of  intersection  AO  B C B,  and  thus  we  have 
A C A O B C B,  which  implies  A C B. 

2.  -(A  U B)  - A O B. 

Proof : a.  If  x € - (A  U B) , then  x < (A  U B) , which  means  that 
x 4 A and  x < B,  since  x C A U B if  x belongs  to 

either  A or  B or  both_^of  them.  But  x i A and  x ^ B 

is  equivalent  to  x C A and  x €.  B , which  by  definition 
is  x € A O B. 

*%•  <W  >v 

b.  If  x f A h B,  then  x € A and  x € B,  which  implies  x ^ A 
and  x 4 B,  from  which  it  follows  that  x cannot  belong 

to  the  union  of  A and  B,  i.e.,  x < (A  U B)  or 

x i - (A  L>  B) . A picture  of  this  is  presented  in 
Figure  7. 


3.  A A B = B A A. 

Proof:  By  definition  A A B = (A  - B)  U (B  - A) , which  equals 
(B  - A)  U (A  - B)  which  equals  BAA.  Therefore, 

A A B = B A A.  Notice  that  for  sets  P,  Q,  PU  Q - Q U P. 
The  reader  should  prove  this,  because  in  the  proof  of 
AAB*B4Ait  was  needed.  In  this  proof  P corresponds 
to  (A  - B)  and  Q corresponds  to  (B  - A) . Figure  8 demon- 
strates this  pictorially. 
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Figure  8 

4.  A U (BO  C)  = (AU  B)  H (A  U C)  . 

Proof : a.  Let  x £ A U (B  O C) , then  x £ A or  x £ (B  0 C) . 


(i)  If  x £ A and  x£  bO  C,  this  implies  x C A, 
x € B,  x C C,  and  clearly  x £ A U B and 
xC  BUC,  i.e.,  x £ (AUB)O  (AUC). 

(ii)  If  x C A and  x < (BO  C),  then  x £ (A  U B)  and 
x £ (A  U C) , regardless  of  whether  xt  B or 

x € Cr  and  therefore,  x € (A  U B)  O (AUC). 

(iii)  If  x 4-  A and  x £ (B  H C)  , then  x t A,  x € B, 

x £ C,  so  again  x C (A  U B)  and  x £ (AUC), 
or  equivalently  x £ (A  U B)  (AUC). 

b.  Let  x C (A  U B)  O (AUC),  then  x £ (AU  B)  and 

x € (AUC);  x £ A U B implies  that  x € A or  x £ B 

and  similarly,  x£  AU  C implies  that  x£  A or  x£  C. 

(i)  If  x £ A,  x C B,  x C C,  clearly  x £ A U (B  n C) . 

In  fact,  if  x £ A,  then  x£  A U (B  O C)  , regard- 

less of  whether  x £ B or  x £ C. 

(ii)  Suppose  x 4.  A,  then  we  must  have  x £ B and 

x£  C,  since  x £ AU  B and  x C AUC.  There- 
fore, xC  B/)C,  and  finally,  x£  AU  (B  O C)  . 

A picture  of  this  is  presented  in  Figure  9. 


Figure  9 


i 
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The  first  chapter  introduced  the  fundamental  idea  of  a set,  its 
terminology,  and  the  types  of  operations  that  may  be  performed  on  sets. 
The  fundamental  nature  of  a set  should  be  clear  from  the  many  and 
varied  uses  of  it  in  this  chapter.  Sets  of  numbers,  red  objects, 
states,  types  of  learning,  United  States  Senators,  states  with  eleva- 
tions above  3000  feet,  words,  noted  psychologists,  people  over  30, 
etc. , were  considered.  The  rich  diversity  of  areas  covered  is  an  il- 
lustration of  the  generalizability  of  the  term.  The  operations  on 
sets,  such  as  union  and  intersection,  allow  us  to  generate  new  sets 
or  describe  sets  with  more  specific  properties. 

An  appropriate  way  of  concluding  the  chapter  is  to  review  the  set 
theoretic  terminology  in  relation  to  the  problem  of  concept  learning. 

In  concept  learning,  an  individual  who  knows  a given  concept,  say  red- 
ness, can  be  shown  a collection  of  stimulus  objects,  i.e.,  a set  of 
stimuli,  and  can  determine  which  stimuli  are  exemplars  of  the  concept 
redness.  He  will  select  only  those  objects  that  are  red  in  color. 

He  is  manifesting  an  understanding  of  the  operation  of  intersection, 
because  each  of  these  objects  is  individually  red.  Those  objects  that 
are  not  red  are  nonexemplars,  and  require  the  application  of  comple- 
mentation. If  a second  concept  is  introduced,  say  triangle,  and  the 
individual  is  asked  to  choose  all  objects  that  are  red  or  triangles, 
then  he  will  select  those  stimuli  that:  are  red,  are  triangles,  or  are 
both  red  and  triangles.  This  would  refer  to  a grasp  of  the  operation 
of  union.  To  find  all  the  objects  that  are  red,  but  not  triangles 
utilizes  the  difference  operation.  Finally,  in  choosing  objects  that 
are  red,  but  not  triangles,  or  objects  that  are  triangles,  but  not  red, 
the  operations  of  symmetric  difference  is  referred  to.  Interesting 
research  is  being  carried  out  to  determine  if  there  exists  a hierarchy 
of  difficulty  among  operations  such  as  those  just  described  in  this 
chapter . 
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CHAPTER  2 


RELATIONS 


There  is  one  further  operation  involving  sets  that  we  would  like 
to  consider.  The  notion  of  a Cartesian  product  of  two  sets  will  be 
fundamental  to  this  chapter.  We  will  need  to  introduce  the  notion  of 
am  ordered  pair.  We  will  take  an  ordered  pair  to  be  two  objects  given 
in  a fixed  order.  Therefore,  (a,b)  is  generally  not  equal  to  (b,a). 

If  the  first  position  represents  the  number  of  ten  dollar  bills  in 
your  wallet,  and  the  second  position  the  number  of  one  dollar  bills 
in  your  wallet,  then  Bob  has  (7,2)  and  Dave  (2,7),  this  means  that 
Bob  has  $72  and  Dave  has  $27,  which  certainly  are  not  the  same.  We 
could  define  am  ordered  pair  in  a more  formal  manner,  but  an  intuitive 
idea  of  the  concept  will  suffice  for  our  purposes.  The  ordered  pairs 
(a,b)  and  (c,d)  will  be  equal  if  and  only  if  a = c and  b = d. 


Definition  6.  The  Cartesiam  product  of  two  sets  A and  B is  de- 
fined to  be  the  set  of  all  ordered  pairs,  (a,b) , such  that  a£A  amd 
b€  B,  and  is  written  A X B.  A X B = { (a,b)  | a C A and  bCB}. 


Examples 

1.  Let  A - {1,2,3}  and  B = {0,5, 10, -2},  then 
A X B = { (a,b)  | at  A and  b£B> 

- {(1,0),  (1,5),  (1,10),  (1,-2),  (2,0),  (2,5),  (2,10), 
(2,-2),  (3,0),  (3,5),  (3,10),  (3,-2)}; 

AX  A-  {(1.1),  (1,2),  (1,3),  (2,1),  (2,2),  (2,3),  (3,1), 
(3,2),  (3,3)}. 

2.,  Any  graphical  data  from  a psychological  experiment  may  be  inter- 
preted in  terms  of  ordered  pairs.  For  example,  in  an  intelligence 
test,  each  individual  has  a particular  score,  or  in  a discussion  of 
S-R  theory,  the  theory  is  described  in  terms  of  stimulus-response 
pairs  called  associations. 


We  all  have  am  intuitive  idea  of  what  we  mean  by  a "relation." 

A "relation"  reflects  some  type  of  association  or  connection  between 
two  entities.  In  order  to  be  more  precise  in  describing  this  vague 
idea  of  a bond  between  entities,  we  want  a mathematical  formulation 
of  a relation.  Two  objects  either  have  this  defined  bond  or  they  do 
not.  Therefore,  we  can  enumerate  the  set  of  all  ordered  pairs  of 


17 


entities  having  this  bond.  Thus,  we  may  think  of  a relation  as  a col- 
lection of  ordered  pairs. 


Definition  7.  Let  A and  B be  sets,  then  a relation  R on  the  Car- 
tesian product  A X B is  any  subset  of  A X B,  i.e.,  RCA  X B.  If  (a,b) 
is  an  element  of  the  collection  of  ordered  pairs  determining  R,  then 
we  may  either  write  (a,b)C  R or  a R b. 


Examples 

1.  If  A = {1,2, 3, 4, 5, 6, 7}  and  B = {3,6,8,11,13,14,19,22},  then  the 
Cartesian  product  A X B has  56  ordered  pairs.  Examples  of  rela- 
tions would  be, 


R1  - 

{(1,3), 

(5,19) , 

(7,6)} 

R2  = 

{(3,6) , 

(4,8), 

(7,14)  } 

R3  ~ 

{(1,3), 

(2,4), 

(4,6), 

(6,8)} 

R4  = 

{ (1,8)  , 

(2,13)  , 

(5,8), 

(1,6)} 

As  may  be  observed,  not  all  relations  have  a clear  connection  be- 
tween elements  in  the  ordered  pairs.  Often  it  is  impossible  to 
come  up  with  a rule  defining  the  relation.  In  R2  we  may  observe 
that  the  ordered  pair  satisfies  b = 2a,  but  Rj  does  not  have  any 
such  well-defined  bond. 

2.  The  notion  of  a relation  has  wide  applicability.  For  example,  any 
verb  phrase  in  a sentence  indicates  a relation.  Consider  the  set 
A to  be  composed  of  the  cow,  the  moon,  and  the  Pied  Piper.  Let 
our  relation  R be  designated  by  "jumped  over."  Now,  only  the  cow 
jumped  over  the  moon,  and  no  other  elements  in  A are  related  by 
"jumped  over";  thus,  the  ordered  pair  (the  cow,  the  moon)  in 
A X A determines  our  relation  R.  Notice  that  (the  cow,  the  moon) 
is  not  the  same  as  (the  moon,  the  cow) , the  latter  being  the  moon 
jumped  over  the  cow. 


Properties  of  Relations 

We  will  discuss  various  important  properties  of  relations  on  A X A, 
i.e.,  A X A = {(a^a^  | a^C  A and  a2€  A}. 
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Definition  H. 


(i)  Let  A be  « set  and  R a relation,  i.e.,  RCA  X A,  then  R 
is  reflexive  if  for  every  af  A,  (a,a)C  R. 

(ii)  R is  irref lexive  if  for  every  aCA,  (a,a)£K. 

(iii)  If  R is  neither  reflexive  or  irreflexive,  then  R is  called 
nonreflexive. 


Examples 

1.  Equality  "«"  in  the  discussion  of  numbers  is  reflexive,  because 
for  every  number,  it  is  equal  to  itself. 

2.  The  relation  "is  less  than,"  is  irreflexive,  since  for  every 

number,  it  is  not  less  than  itself.  A more  concrete  example  is  the 
relation  "weighs  less  than.”  Even  though  many  dieters  wish  it  were 
true,  no  one  weighs  less  than  himself,  so  "weighs  less  than"  is 
irreflexive . 

3.  However,  the  relation  "is  less  than  or  equal  to,"  is  reflexive, 

since  for  instance,  every  number  is  less  than  or  equal  to  itself. 

4.  Another  irreflexive  relation  is  being  a mother,  because  no  one  is 
her  own  mother. 

S>.  In  compar isons  such  as  "is  as  intelligent  as,"  "is  as  kind  as," 

"is  as  tall  as,"  etc.,  we  have  examples  of  reflexive  relations 
from  everyday  language. 

6.  There  exist  relations  that  are  neither  reflexive  nor  irreflexive. 

Let  A » (x,y),  hence  A X A » {(x,x),  (x,y),  (y,x),  (y,y)  l.  Define 
R - {(x,x),  (x,y)},  then  we  may  observe  that  R is  not  reflexive 
because  (y,y)(  R,  and  R is  not  irreflexive  because  (x,x)C.R.  There- 
fore, R is  nonreflexive. 


Definition  9. 

(i)  Let  A be  a set  and  RCA  X A,  then  R is  symmetric  if  for 
every  a,b€  A,  (a,b)€  R implies  (b,a)€  R. 

(ii)  R is  asymmetric  if  for  every  a.bCA,  (a,b)€  R implies 
(b.a)ffc R. 

(iii)  R is  antisymmetric  if  for  every  a.bCA,  whenever  (a,b)£  R 
and  (b,a)£  R,  then  a - b. 
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Examples 


1.  Equality  is  symmetric,  since  if  a • b,  then  clearly  b = a. 

2.  However,  "is  less  than,"  "<"  is  not  symmetric,  since  for  example , 

5 < 6 does  not  imply  6 < 5.  Actually,  "<"  is  asymmetric. 

3.  An  example  of  an  antisymmetric  relation  is  less  than  or  equal  to, 

"i."  It  is  neither  symmetric  or  asymmetric.  Because  5 s 6,  but 

6 < 5,  we  see  that  "v"  is  not  symmetric.  Further,  since  5 j 5 

implies  5 5 5,  is  not  asymmetric.  "i"  is  antisymmetric  because 

the  only  way  one  number  can  be  both  greater  than  or  equal  to,  and 
less  than  or  equal  to  another  number  is  if  it  equals  that  number. 

4.  "CM  or  "is  included  in"  is  another  example  of  an  antisymmetric 
relation.  We  made  use  of  this  assertion  in  several  proofs  in 
Chapter  1.  In  proving  that  two  sets  were  equal,  for  instance, 

A *=  B,  we  proved  that  AC  B and  that  BCA,  from  which  we  concluded 
that  A = B. 

5.  An  example  that  each  of  us  can  identify  with  is  the  relation  "loves." 
Sam  loves  Sally,  but  Sally  does  not  love  Sam.  Poor  Sam,  loving  is 
not  symmetric.  Actually  loving  is  not  symmetric  or  asymmetric  or 
antisyrmnetr ic.  It  is  not  asymmetric,  since  fortunately  for  us  all, 
there  exist  cases  where,  for  example,  Romeo  loves  Juliet,  and  Juliet 
loves  Romeo.  Loving  is  not  antisymmetric,  since  this  would  imply 
that  if  one  person  loves  a second  person,  and  conversely,  then  the 
two  people  must  be  the  same  person.  This  would  mean  a world  without 
any  couples  in  love.  Romanticism  aside,  the  relation  "loves"  would 
be  an  instance  of  a nonsymmetric  relation. 

6.  More  concrete  examples  of  a symmetric  relation  would  be  "is  exactly 
as  tall  as,”  "is  exactly  as  intelligent  as,"  etc.,  while  relations 
such  as  "is  taller  than"  and  "weighs  more  than"  would  be  asymmetric. 

7.  The  relation  "is  the  next  door  neighbor  of"  is  an  example  of  a sym- 
metric relation,  since  if  Jones  lives  next  door  to  Smith,  Smith 
lives  next  door  to  Jones. 

8.  A psychological  example  of  an  asymmetric  relation  would  be  "is  rein- 
forced if  he  chooses."  In  a particular  trial  an  individual  is  rein- 
forced if  he  makes  the  correct  choice,  and  is  not  reinforced  if  he 
makes  the  wrong  choice.  Suppose  A is  correct  and  B is  incorrect, 
then  Tom  is  reinforced  if  he  chooses  A over  B,  but  Tom  is  not  rein- 
forced if  he  chooses  B over  A. 


Definition  10.  Let  A be  a set  and  RCA  X A,  then 

(i)  R is  transitive  if  for  every  a,b,c€A,  if  (a,b)  and  (b,c)£  R, 
then  (a,c) £ R; 


•f 
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(ii)  R is  intransitive  if  for  every  a,b,c£A,  if  (a,b)£  R and 
(b,c)€  R,  then  it  is  not  the  case  that  (a,c)£  R; 

(iii)  If  R is  neither  transitive  or  intransitive,  then  R is 
nontransitive. 


Examples 

1.  Equality  is  transitive.  If  a = b and  b = c,  then  we  have  a = c. 

2.  Another  transitive  relation  is  "is  less  than,"  "<,"  for  is  a < b 
and  b < c,  then  a < c. 

3.  Set  inclusion,  "C,”  is  transitive.  If  ACB  and  BCC,  then  ACC. 

4.  Returning  to  our  discussion  of  love,  if  Sam  loves  Sally  and  Sally 
loves  Jim,  it  is  most  unlikely  that  Sam  loves  Jim.  However,  under 
some  conditions  Sam  may  love  Jim.  Therefore,  "loves"  is  a nontran- 
sitive relation. 

5.  If  Ann  is  Mary's  mother,  and  Mary  is  Betty's  mother,  this  does  not 
imply  that  Ann  is  Betty's  mother.  "Is  the  mother  of"  is  an  ex- 
ample of  an  intransitive  relation. 

6.  The  height  of  people  designates  many  relations.  For  example,  "is 
taller  than"  is  transitive.  If  Tom  is  taller  than  Dick,  and  Dick 
is  taller  than  Harry,  then  Tom  is  taller  than  Harry. 

7.  Suppose  R = {(1,2),  (2,3),  (3,4),  (2,4)},  then  R is  not  transitive, 
because  (1,2)£R  and  (2,3)€R,  but  (1,3)  ( R.  Also,  R is  not  in- 
transitive, since  (2,3)  CR  and  (3,4)€R,  but  (2,4)€R,  contrary  to 
the  definition  of  intransitivity.  Therefore,  R is  nontransitive. 

8.  Piaget  describes  four  levels  of  operations  in  his  theory;  sensori- 
motor, pre-operational , concrete,  and  formal.  The  ages  of  transi- 
tion to  a higher  level  may  vary,  but  the  order  is  fixed.  There- 
fore, the  relation  "is  a prerequisite  to"  is  an  example  of  a 
transitive  relation.  If  sensori-motor  operations  are  prerequisite 
to  concrete  operations,  and  concrete  operations  are  prerequisite 
to  formal  operations,  then  sensori-motor  operations  are  prerequi- 
site to  formal  operations. 


Those  properties  of  relations  discussed  in  Definitions  8,  9,  and 
10  are  the  ones  we  are  most  interested  in,  but  for  completeness  we  will 
include  several  additional  ones. 


Definition  11.  If  A is  a set  and  RCA  x A,  then  R is  connected 
if  for  every  a,bCA,  whenever  a / b,  then  (a,b)C  R or  (b,a)C  R. 
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Examples 


I 
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1.  The  relation  "is  less  than,"  "<"  is  connected.  If  a ? b,  then 
a < b or  b < a. 

2.  Set  inclusion  is  not  connected.  If  A / B,  it  is  not  necessarily 
the  case  that  ACB  or  BCA.  It  is  possible  that  AOB  = <j>,  or 
that  we  do  not  have  inclusion,  but  rather  partial  overlap. 

3.  The  relation  "loves"  is  not  connected,  because  it  is  conceivable 
that  Alan  does  not  love  Ellen,  and  Ellen  does  not  love  Alan. 


Definition  12.  If  A is  a set  and  RCA  X A,  then  R is  circular 
if  (a,b)€.R  and  (b,c)€  R imply  that  (c,a)€R. 


Examples 

1.  Equality  is  a circular  relation.  If  a = b and  b = c,  then  c = a. 

2.  The  relation  "is  a sibling  of"  is  another  circular  relation.  If 
Fred  is  a sibling  of  Harvey  and  Harvey  is  a sibling  of  Morty,  then 
Morty  is  a sibling  of  Fred. 

3.  Proper  set  inclusion  is  an  example  of  a relation  that  is  not  circu- 
lar. If  A $. B and  B$C,  it  is  not  true  that  C§A. 


For  those  readers  who  would  like  to  see  the  newly  introduced 
properties  used  in  a more  formal  way,  the  following  two  problems  are 
included. 


Problem  1.  Suppose  that  a relation  R is  transitive  and  symmetric. 
Give  an  example  to  show  that  R need  not  necessarily  be  reflexive. 

One  may  try  to  argue  as  follows:  For  a,b£A,  by  symmetry  (a,b)€  R 
implies  that  (b,a)€R.  But  if  (a,b)€R  and  (b,a)€R,  then  by  transi- 
tivity (a,a)€  R,  from  which  it  is  tempting  to  conclude  that  R is  re- 
flexive. We  must  investigate  why  the  above  argument  is  fallacious. 

Let  A = {a,b}  and  R = { (b ,b) } . In  this  example  (b,b)  is  the  only  ele- 
ment in  R.  R is  not  reflexive  because  (a,a)£  R,  and  for  R to  be  re- 
flexive both  (a, a)  and  (b,b)  must  belong  to  R.  However,  R is  trivially 
symmetric  and  transitive. 


Problem  2.  Show  that  a relation  is  reflexive  and  circular  if  and 
only  if  it  is  reflexive,  symmetric,  and  transitive.  (This  is  a problem 
in  A Survey  of  Modern  Algebra  by  Birkhoff  and  MacLane,  1964.) 
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Proof:  (1)  Suppose  R is  reflexive  And  circular.  Therefore, 

for  every  a,b,cCA,  (a,a)«R,  And  further  (A,b)(K  And  H implies 

t hat  (c,a)C  k by  circulArlty. 

Show  K ia  symmetric.  Suppose  (a,b)€  Rj  by  the  reflexivity  of  R, 
(b,b)€  R as  well.  Now  by  circularity,  (a,b)£  R and  (b,b)<  R imply 
(b,a)C  R.  Thus,  (a,b)£  R implies  (b,a)C  r. 

Show  R is  transitive.  If  (a.b)CR  and  (b,c)£  R,  by  circularity 
we  have  (c,a)tR,  but  by  the  iust  proven  symmetry,  it  follows  that 
(a,c)C  R.  Hence,  if  (a,b)€R,  and  (b,c)C  R,  then  (a,c)C  R. 

(ii)  Suppose  R is  reflexive,  symmetric , and  transitive. 

We  must  show  only  that  R is  circular,  since  it  is  qiven  t hat  K is  al 
ready  reflexive.  If  (a,b)£R  and  (b,c)CR,  then  (a,c)C  R by  the 
transitivity.  Next  by  symmetry  (a,c)€R  implies  that  (c,a)€R. 
Therefore,  (a,b)CR  and  (b,c)CR  imply  that  (c,a)  € R. 

To  help  clarify  the  descriptive  caivibi  1 ities  of  the  proi'erties 
tliat  have  been  discussed,  Table  l has  been  constructed  to  indicate 
th<  properties  of  ten  relations.  In  Table  1 a set  of  elements  for 
which  a cited  relation  is  to  be  operative  is  indicated  foi  each  i ela- 
tion. The  relations  in  Table  l tend  to  fall  into  groupings  according 
to  their  properties.  Some  relations  such  as  "equals"  and  "is  exactly 
as  kind  as"  are  reflexive,  symmetric,  and  transitive.  Relations  with 
those  properties  are  termed  equivalence  relations.  Other  relations 
such  as  "is  greater  than,"  "weighs  more  than,"  and  "is  less  intelli- 
gent than"  are  irreflexive,  asymmetric,  and  transitive.  With  t lie 
twelve  proper t ies  cited  in  Table  1 the  logical  qualities  of  any  re- 
lation can  be  richly  articulated. 


Equivalence  Re  l at  ions 

Definition  13.  If  A is  a set  and  RCA  X A,  then  R is  an  eijuiva- 
lence  relation  if: 

(i)  For  every  a€  A,  (a,a)€R  (reflexivity) » 

(ii)  For  every  a,b€A,  (a,b)CR  implies  (b,a)CR  (symmetry) » 

(lii)  For  every  a,b,cCA,  (a,b)f  R and  (b,c)£R  imply  (a,c)C  R 
(transitivity) . 


Examples 

l.  Equality  for  numbers  is  an  equivalence  relation,  because  is 
reflexive,  symmetric,  and  transitive. 


Table  1 


A Classification  of  Some  Relations  ] 
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irref lexive 


The  relation  "is  less  than”  is  not  an  equivalence  relation  because 
"<M  is  not  symmetric. 

Let  the  states  of  the  United  States  form  the  set  under  considera- 
tion. Then  we  could  define  a relation  R by  (x,y)£  R,  where  x,y 
are  statos,  if  both  states  x and  y have  governors  whose  last  names 
begin  with  the  same  letter.  For  example,  if  the  letter  was  S,  the 
states  would  include  Massachusetts  (Sargent),  Pennsylvania  (Shapp) , 
Texas  (Smith),  etc.  The  relation  would  be  reflexive,  because  for 
instance  (Texas,  Texas) C K.  The  relations  would  be  symmetric,  be- 
cause if  for  instance  (Texas,  Pennsylvania) C R,  then  (Pennsylvania, 
Texas)tR.  Tlte  relation  is  transitive.  Consider,  if  we  look  at 
(Texas,  Pennsylvania) € R and  (Pennsylvania,  Massachusetts) £ R,  then 
(Texas,  Massachusetts) € R.  Therefore,  R as  defined  above  would  bo 
an  equivalence  relation. 

Actually  we  would  be  able  to  divide  the  states  up  into  mutually 
disjoint  groupings  because  each  state  would  fall  into  only  one 
category,  depending  on  the  initial  letter  of  the  state's  governor's 
name.  Granted  that  this  particular  partitioning  does  not  reflect 
any  real  division  according  to  national  importance  of  political 
ideology  of  the  individual  governors,  but  it  is  an  example  of  how 
we  can  often  divide  a collection  of  items  or  people  into  disjoint 
subcollections  with  each  subcollection  representative  of  some 
unique  property.  The  actual  significance  of  such  a representation 
depends  on  the  importance  or  value  of  the  defined  relation.  We 
will  follow  up  this  idea  of  partitioning  in  a mine  precise  and 
mathematical  presentation  later  in  the  book. 

Let  Z be  the  set  of  all  integers,  i.e.,H  - l . . . , - 1 , - 2 , -1 ,0 , 1 , 2 , 3 , 
...}.  Define  for  m,n,C2L,  (m.n)*-  R if  m - n is  a multiple  of  S, 
i.e.,  if  m - n - 5t  for  some  integer  t.  R is  an  equivalence 
relation. 

(i)  (m,m)£  R for  every  m£fc,  because  m - m - 0 - '>(0),  where 
0€  2.  Therefore,  R is  reflexive. 

(ii)  If  (m,n)£R,  then  there  exists  an  integer  t such  that 

m - n - 5t.  Therefore  n - m - -St , but  -5t  - S (-t ) and  -t 
is  an  integer.  Hence,  (n,m)€  R and  R is  symmetric. 

(iii)  If  (m,n)CR  and  (n,p)€R,  then  for  some  integers  k and  j, 

we  have  m - n - !ik  and  n - p - Sj.  Therefore,  m - p • (m  - n) 

♦ (n  - p)  - 5k  + 5j  - 5(k  + j)  - 51,  where  i - k ♦ j is  sons’ 

integer.  Hence  (m,p)C  R and  R is  transitive. 

The  next  example  will  at  first  appear  to  be  quite  difficult,  but 
at  a closer  inspection,  it  may  be  observed  that  we  are  merely  es- 
tablishing the  equivalence  of  fractions  such  as  i/'>,  4/10,  10/25, 
etc.,  by  stating  that  the  product  ot  the  means  o<pials  the  product 


of  the  extremes.  For  example,  2/5  = 4/10  because  2(10)  = 5(4). 

Now  to  the  example,  let  a,b,c,d£Z,  and  let  M * the  set  of  all 
ordered  pairs  of  integers  (a,b)  with  b / 0.  Define  R as  ((a,b), 
(c,d))£  R if  and  only  if  ad  = be.  (Notice  this  is  the  same  as 
saying  ((2,5),  (4,10))  €R  if  and  only  if  2(10)  - 4(5). 

It  must  be  shown  that  R is  an  equivalence  relation. 

(i)  If  (a,b)£  M,  then  ((a,b),  (a,b))  is  an  element  of  R,  because 
ab  = ba.  Thus,  we  have  proven  that  R is  reflexive. 

(ii)  If  (a,b)£M  and  (c,d)CM,  and  suppose  further  that  ((a,b), 
(c,d))€  R,  then  by  definition  we  have  ad  = be,  which  by  re- 
arrangement implies  cb  = da,  and  therefore,  ((c,d),  (a,b))£  R, 
and  symmetry  has  been  demonstrated. 

(iii)  Let  (a,b) , (c,d) , and  (e,f)  be  elements  of  M,  and  suppose 

that  ( (a,b) , (c,d) ) € R and  ( (c,d) , (e,f ) )£  R,  then  we  have 
that  ad  = be  and  cf  = de.  Therefore,  upon  multiplying 

ad  = be  by  f we  obtain  adf  = bef,  and  multiplying  of  cf  = de 
by  b,  we  obtain  bef  = bde.  Hence,  adf  = bef  and  bef  = bde, 
and  by  the  transitivity  of  the  equality  relation,  we  have 
adf  = bde,  which  we  may  rewrite  as  afd  = bed.  By  hypothesis 
d / 0,  and  therefore  d-1  = 1/d  exists.  Multiplying  both 
sides  of  the  equality  afd  = bed  by  d"l  we  obtain  af  = de, 
i.e.,  ((a,b),  (e,f))£R.  Hence,  R is  transitive. 


In  the  example  about  states  having  governors  whose  last  names  be- 
gin with  the  same  letter,  a brief  description  was  included  of  how  the 
states  could  be  broken  up  into  disjoint  groupings.  This  is  a very 
valuable  procedure  in  considering  sets,  and  will  be  now  presented  in  a 
more  thorough  manner. 

Definition  14.  Let  A be  a set  and  RC  A X A,  then  the  equivalence 
class  of  a A is  the  set,  {x€A  | (a,x)£  R),  which  we  shall  denote  by 
either  [a]  or  c 1 (a). 


Examples 

1.  We  have  already  shown  that  equality  is  an  equivalence  relation. 

If  a€A,  then  [a]  = (a),  since  (a,x)€  R if  and  only  if  a = x. 

2.  Let  Cbe  the  set  of  all  integers.  Define  for  m,n<2,  (m,n)£R  if 
m - n is  a multiple  of  5.  We  demonstrated  already  that  R is  an 
equivalence  relation.  Then  for  a££, 
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[a]  » (x£  A | (a,x)£  R} 

“ {x€A  | a - x = 5i,  i = 0,  tl,  ±2,  * • • }. 

Therefore,  we  may  divide  the  integers  into  five  distinct  equiva- 
lence classes,  [0],  [1],  [2],  [3],  [4).  Note  that,  for  example 

(2]  - [7],  since  both  are  equal  to  {*•* ,-8 ,-3 ,2,7,12, •••} . Thus, 
we  may  divide  the  integers  according  to  whether  the  remainder 

is  0,1, 2, 3,  or  4 upon  division  by  5.  Hence, 2 = {[0],  (1],  [2], 

[3] ,  [4]}. 

3.  Joseph  Scandura  has  created  a new  language  to  describe  what  (rule) 
is  learned  in  a particular  task.  He  calls  this  language  set  func- 
tion language  (SFL) , and  it  utilizes  the  term  equivalence  class. 

His  theory  is  as  follows:  A particular  stimulus  is  observed,  and 
it  is  then  assigned  to  the  appropriate  class  of  stimuli,  on  the 
basis  of  its  defining  properties.  A rule  is  then  a mapping  from  a 
class  of  stimuli  to  a class  of  responses,  from  which  the  required 
response  is  selected  from  the  class  of  functionally  equivalent  re- 
sponses. An  example  would  be  the  following.  Let  [1+3+5]  con- 
sist of  elements  such  as  1 apple  + 3 apples  + 5 apples,  $1  + $3  + $5, 
1 dot  + 3 dots  + 5 dots,  etc.  Let  [9]  consist  of  elements  such  as 

9 apples,  $9,  9 dots,  etc.  Then  the  rule  is  an  operation  between 
equivalence  classes  of  number  series  and  their  sums.  An  example, 
in  computing  $1  + $3  + $5,  it  is  first  recognized  as  an  instance 
of  [1  + 3 + 5]  which  by  a rule  is  mapped  into  [9],  from  which  the 
appropriate  response  $9  is  selected.  A more  detailed  account  of 
the  theory  may  be  found  in  Scandura  (1970) . 

4.  Equivalence  classes  are  used  as  part  of  the  underlying  structure 
in  a paper  by  David  H.  Krantz  (1964),  "Conjoint  Measurement:  The 
Luce-Tukey  Axiomatization  and  Some  Extensions." 


In  Example  2 it  was  shown  that  the  integers  could  be  divided  up 
into  five  equivalence  classes,  [0],  [1],  [2],  [3],  and  [4].  This 
process  of  dividing  up  a set  is  referred  to  as  a partition. 


Definition  15.  A partition  of  a set  A is  a collection  of  nonempty 
subsets  of  A that  are  disjoint  and  whose  union  is  A. 

There  is  a theorem  in  mathematics  that  describes  the  relationship 
between  the  equivalence  classes  of  an  equivalence  relation  and  a par- 
tition of  a set.  This  theorem  is  most  useful  in  mathematics,  because 
of  the  way  it  allows  a set  to  be  divided  into  meaningful  subsets.  It 
can  be  equally  valuable  In  psychology  as  a means  of  dividing  up  experi- 
mental data,  stimuli,  concepts,  etc.  into  important,  distinctive  sub- 
categories.  The  theorem  will  not  be  proven  in  this  book,  but  may  be 
found  in  any  standard  abstract  algebra  book,  such  as  Herstein  (1964) 
or  Dean  (1966) . 
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Theorem  (i)  The  distinct  equivalence  classes  of  an  equival . nee 
relation  on  A provide  us  with  a partition  of  A,  i.e.,  they  provide  us 
with  a decomposition  of  A into  mutually  disjoint  nonempty  subsets  whose 
union  equals  A. 

(ii)  Conversely,  given  a partition  of  A into  mutually  dis- 
joint nonempty  subsets,  we  can  defipe  an  equivalence  relation  on  A,  for 
which  these  subsets  are  the  distinct  equivalence  classes. 


Examples 

1.  We  have  already  discussed  that  the  integers  may  be  divided  into 
[0],  [1],  [2],  [3],  and  [4],  if  the  relation  is,  for  m,nf£, 

(m,n)€R  if  m - n is  a multiple  of  5.  That  is,  we  divided  the  in- 
tegers according  to  whether  the  remainder  was  found  to  be  0,  1, 

2,  3,  or  4,  upon  division  by  S. 

2.  If  the  relation  had  been,  for  m,n€£,  (m,n)£  R if  m - n is  a multi- 
ple of  7.  Then  the  integers  would  have  been  partitioned  into 

[0] ,  [1],  (2],  [3],  [4],  [5J,  and  [6J. 

3.  In  a used  car  lot,  if  the  owner  divides  his  cars  into  groupings, 
where  all  the  cars  in  one  grouping  are  one  make,  all  the  cars  in 
the  next  grouping  are  another  make,  etc.,  then  he  is  partitioning 
the  cars  into  disjoint  nonempty  subsets.  For  example,  there  is  a 
grouping  of  Fords,  Pontiacs,  Plymouths,  etc.  We  could  define  an 
equivalence  relation  on  the  set  consisting  of  Friendly  Freddie's 
Forever  Lasting  Cars.  If  a,b  are  cars  in  Freddie’s  lot,  then 
(a,b)6  R if  a and  b are  the  same  make.  We  now  show  that  R is  an 
equivalence  relation: 

(1)  (a,a)£.R,  because  clearly  a car  is  the  same  make  as  itself. 
Therefore,  R is  reflexive. 

(ii)  If  (a,b)€R,  then  (b,a)€  R,  because  if  a and  b are  the  same 
make,  certainly  b and  a are  the  same  make:  R is  symmetric. 

(iii)  If  (a,b)£R  and  (b,c)£*  R,  then  a and  b are  the  same  make, 
also  b and  c are  the  same  make,  and  therefore  a and  c are 
both  the  same  make,  or  (a,c)£R,  from  which  we  conclude  that 
R is  transitive.  In  this  example  we  have  illustrated  the 
converse  of  the  theorem,  i.e. , according  to  the  way  the  set 
of  cars  was  divided  up  it  was  possible  to  define  an  equiva- 
lence relation  on  the  set  of  cars. 

4.  An  application  to  psychology  would  be  in  a conditioning  experiment. 
The  animal  is  conditioned  to  push  one  of  two  buttonr . His  responses 
may  be  divided  into  two  disjoint  sets  whose  union  consists  of  all 
his  responses.  The  animal  either  presses  the  correct  button  or 

the  wrong  button. 
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5.  In  a discrimination  task,  the  individual  may  be  asked  to  divide 
up  the  stimuli  according  to  color.  Therefore,  the  set  of  stimuli 
are  divided  into  classes,  with  each  class  consisting  of  stimuli 
of  a particular  color. 

6.  In  a rule-oriented  subject  matter  such  as  mathematics,  a person 
learns  to  do  many  problems  on  the  basis  of  one  rule.  He  must 
analyze  a problem,  decide  which  rules  are  relevant,  and  then  ap- 
ply the  rules.  Therefore,  each  individual  problem  is  not  treated 
as  an  isolated  case. 


The  examples  have  hopefully  given  further  illustration  of  how  funda- 
mental this  theorem  is  and  how  relevant  it  is  to  questions  in  psychology. 
The  theorem  essentially  describes  a person's  ability  to  organize  and 
classify. 


Types  of  Ordering 

With  the  completion  of  our  discussion  of  equivalence  relations,  we 
begin  a discussion  of  various  types  of  ordering.  The  names  attached 
to  these  orders  vary  in  the  literature,  and  one  must  be  careful  to  make 
note  of  the  possible  distinctions  between  texts.  The  definitions  and 
names  that  we  will  use  in  this  book  seem  to  be  the  most  common.  We 
begin  with  a list  of  definitions,  and  then  follow  the  definitions  with 
relevant  examples  and  references  as  to  where  in  the  psychological 
literature  applications  of  ordering  may  be  found. 


Definition  16.  A relation  " < " is  a partial  ordering  for  a set  A 
if  < is  reflexive,  antisymmetric,  and  transitive,  i.e., 

(i)  for  every  aC  A,  a < a; 

(ii)  for  every  a,b€A,  a < b and  b < a implies  a - b>  and 

(iii)  for  every  a,b,c€A,  a < b and  b ^ c imply  a .<  c. 


Definition  17.  A relation  is  a strict  partial  ordering  of  A 
if  < is  antisymmetric  and  transitive.  Therefore,  we  could  call  a par- 
tial ordering  a reflexive  strict  partial  ordering. 


Definition  18.  A relation  is  a linear  ordering  (also  called 

simple  or  total)  of  A if  < is  reflexive,  antisymmetric,  transitive,  and 
connected.  That  is,  if  < is  a partial  ordering  and  in  addition  for 
every  a,b£A,  if  a f b,  then  a<  b or  b^a. 
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Definition  19.  A relation  “<"  is  a strict  linear  orderinc 
K,  is  antisymmetric,  transitive,  and  connected. 


We  may  use  diagrams  to  indicate  the  different  types  of  ordering. 
For  example,  if  one  can  reach  one  element  of  a set  from  another  ele- 
ment in  the  set  in  a continually  ascending  manner,  then  the  elements 
are  ordered.  Let  us  consider  a set  A,  where  A = {a,b,c,d}.  Suppose 
that  the  elements  of  A are  related  as  indicated  in  Figure  10.  We  may 
observe  that  a < b,  a < c,  a < d,  b < d,  and  c < d,  but  b < c and 
c 4-  b.  Therefore,  the  order  defined  by  Figure  10  would  be  a partial 
ordering  or  a strict  partial  ordering,  depending  on  whether  we  allow 
reflexivity.  However,  this  ordering  is  not  linear,  since  neither 
b c or  c ^ b. . The  diagram  for  a linear  or  simple  ordering  would 
have  to  be  along  a single  vertical  line  such  as  in  Figure  11,  where 
a-<b,  a^c,  a < d,  b^.c,  b ■<,  d,  and  c ^ d.  Therefore,  the  connec- 
tivity property  is  satisfied,  unlike  in  the  previous  illustration, 
where  there  existed  a pair  where  b ^ c and  c ^ b. 


Figure  10 


Figure  11 


The  figures  were  introduced  as  a visual  aid  in  understanding  the 
concepts  of  partial  and  linear  ordering.  We  now  give  a series  of  ex- 
amples to  indicate  the  kinds  of  relations  that  are  partially  or  linearly 
ordered.  We  will  begin  with  a few  relations  that  we  have  discussed  in 
detail  already. 


Examples 

1.  Consider  < for  integers.  This  is  a linear  ordering,  because  for 
any  integers  m,  n,  and  p, 

(i)  m < m for  all  m,  i.e.,  for  any  integer,  it  is  less  than  or 
equal  to  itself; 

(ii)  if  m < n and  n s m,  then  the  only  possibility  is  that  m =*  n; 
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(iii)  if  m i n and  n p,  this  clearly  implies  that  m * p (for 
example,  if  3 s 5 and  5 j 11,  then  3 s 11); 

(iv)  for  any  m,n  where  m f n,  then  either  m s n or  n < m (this 
means  that  if  two  numbers  are  not  equal,  then  one  of  the  two 
is  the  larqer) . Combining  (i) , (ii),  (iii),  and  (iv)  we 
have  shown  that  * is  a linear  ordering. 

2.  If  we  consider  we  immediately  notice  that  "less  than"  is  not 

reflexive.  The  other  properties  hold.  Therefore,  ^ is  a strict 
linear  ordering. 

3.  Set  inclusion,  "C, " is  a partial  ordering,  but  not  a linear  ordering. 

(i)  For  any  set  A,  ACA.  Every  set  is  a subset  of  itself. 

(ii)  For  any  sets  A and  B,  if  ACB,  and  BCA,  then  A = B. 

(iii)  For  any  A,  B,  and  C,  if  ACB  and  BCC,  then  ACC.  This  is 
obviously  true,  but  if  there  are  any  nonbelievers,  the  Venn 
diagram  in  Figure  12  gives  an  intuitive  demonstration. 


© 


implies 
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Figure  12 


(iv)  For  any  sets  A and  B,  where  A / B,  we  need  not  have  ACB  or 

BCA.  In  fact  we  could  even  have  A OB  = 41 . If  A = (1,3,5, 7) 
and  B = (2,4,6, 8),  then  AO B = 41 . Therefore,  set  inclusion 
is  not  connected,  and  the  relation  "C"  is  a partial  ordering. 

4.  Proper  set  inclusion,  is  a strict  partial  ordering,  since  it 

is  not  reflexive.  No  set  is  a proper  subset  of  itself. 

5.  Examples  1 through  4 served  to  illustrate  the  four  new  definitions. 
There  are  analogous  real  world  parallels.  For  example,  "is  taller 
than"  is  a strict  linear  order.  It  is  not  reflexive,  because  no 
one  is  taller  than  himself. 


6.  Within  many  branches  of  psychology  such  as  developmental  psy- 
chology, there  is  discussion  of  hierarchies  of  events.  For  ex- 
ample, in  the  developmental  psychological  theory  of  Jean  Piaget 
(Piaget  & Inhelder,  1969)  there  is  elaborated  a linear  hierarchy 
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of  cognitive  operations.  Piaget  contends  that  a cognitive  pre- 
operational  schema  such  as  graspinq  precedes  the  cognitive  concrete 
operation  of  classification  in  development  which  in  turn  precedes 
the  cognitive  formal  operation  of  hypothet ico-deductive  thinking 
in  development . A sequence  of  behavioral  forms  of  this  type  has 
the  nvithemat ical  properties  of  a linear  ordering  with  the  relation 
being  "is  a prerequisite  to"  or  "is  a necessary  condition  for." 

To  Piaget,  classes  of  cognitive  behaviors--preoperational , concrete, 
and  formal — are  reflexive,  antisymmetr ic , transitive,  and  connected 
for  the  relation  of  "is  a necessary  condition  for."  To  demonstrate 
that  a class  of  behavioral  phenomena  comply  to  some  ordering  for 
some  relation,  empirical  conditions  must  be  formulated  that  will 
allow  for  the  testing  of  the  defining  properties  of  the  relation. 

For  example,  in  the  case  of  the  riagetian  cognitive  theory  one  may 
consider  two  types  of  cognitive  operations  and  if  one  operation  is 
not  demonstrated  to  be  a prerequisite  to  the  other  operation,  then 
the  connected  property  cannot  be  attributed  to  that  relation  and 
the  relation  is  thus  not  a linear  ordering.  The  terminology  of  re- 
lations and  ordering  can  be  used  not  only  to  describe  qualitatively 
the  structural  properties  of  arrays  of  behavioral  phenomena,  but 
also  aid  in  the  formulation  of  the  empirical  conditions  by  which 
one  can  test  the  structures  and  hierarchies  attributed  to  an  array 
of  behavioral  phenomena. 

7.  Airasian  and  Bart  ( 1 '' 7 1 ) have  introduced  ordering  theory,  formally 
referred  to  as  tree  theory,  as  an  alternative  measurement  model. 
Ordering  theory  has  as  its  primary  purpose  the  testing  of  hypothe- 
sized hierarchies  among  items,  or  sometimes  the  determination  of 
such  hierarchies.  Ordering  theory  is  similar  to  other  classical 
models  in  that  it  utilizes  the  item  response  matrix,  but  it  differs 
in  that  it  does  not  use  summative  scores.  Also,  the  classical  ap- 
proaches assume  that  the  trait  measured  is  linearly  ordered,  which 
usually  is  never  tested  for.  Order  theory  does  not  use  summative 
scores  as  a starting  point  for  statistical  analysis,  but  rather  is 
us«vi  to  determine  logical  relationships  between  items  represented 
in  the  item  response  matrix. 

8.  The  next  example  is  again  a more  mathematical  one:  It  serves  the 
purpose  of  illustrating  the  new  terminology  in  a more  abstract  way. 
Let  C*  be  the  positive  integers,  i.e.,  {1,2,3,--- >.  Define  "|" 
to  mean  divides:  Therefore,  a|b  moans  at  - b,  for  some  tc 

We  will  show  that  "|"  is  a partial  ordering. 

(i)  For  any  m€t+,  m|m,  since  m-l  » m. 

(ii)  For  m,n€t*,  if  m|n  and  n|m,  then  there  exists  t and  s in 

♦ , such  that  mt  « n and  ns  » m.  Therefore,  by  substitution 
(mt)s  - m,  which  wo  may  rewrite  as  n(ts)  - m.  Hence,  ts  - 1, 
but  both  t and  s being  positive  integers  imply  t - s » 1. 
Therefore,  mt  •*  m • n , and  antisymmetry  is  proven. 
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(iii)  For  m,n,p€!  £.  , if  m|n  and  n|p,  then  there  exist  t and  s 

in  such  that  mt  « n and  ns  « p.  Which  upon  substitution 
yields  (mt)s  - p or  m{ts)  - p,  but  ts  equals  an  integer,  say 
q£t+,  and  this  implies  mq  » p.  Thus,  we  may  conclude  that 
m|p  and  M["  is  transitive.  We  have  now  proven  that  ”|M  is  a 
partial  ordering.  We  may  show  that  "|”  is  not  a linear 
ordering. 

(iv)  For  example,  consider  3,7  CZ*,  but  3^7  and  7^3.  Therefore, 
divides  is  not  connected. 

9.  The  last  example  that  we  will  consider  is  that  of  lexicographic 
ordering.  Suppose  that  sets  A and  B are  linearly  ordered.  Con- 
sider the  Cartesian  product  of  A and  B,  i.e.,  A X B.  It  may  be 
proven  that  A X B may  be  linearly  ordered  by  <,  where  we  define 
(a,b)  < (a'*,b”')  if  and  only  if  a a'',  or  if  a = a then  if 
b <2  b1,  We  are  denoting  the  strict  linear  order  for  A by  and 
the  linear  order  for  B by  <2-  The  proof  that  < is  a linear  ordering 
is  not  that  difficult,  but  requires  much  cumbersome  notation  and 
the  consideration  of  separate  cases.  Because  of  this  fact,  a proof 
will  not  be  included.  Instead  several  interesting  applications 
will  be  discussed.  Suppose  that  set  A equals  set  B,  and  that  the 
members  or  elements  of  the  set  are  the  letters  of  the  alphabet, 
i.e.,  A =*  B * {a,b,c,  • • • ,x,y  ,2 } . The  ordering  of  A (and  B)  will 
be  the  normal  alphabetical  ordering.  Then  lexicographic  ordering 
is  a precise  and  elegant  way  of  describing  how  a dictionary  is  put 
together.  If  two  words  are  compared,  and  if  the  first  letters  are 
different  we  order  the  two  words  on  the  basis  of  the  alphabetical 
order  of  the  first  letters  of  the  two  words.  If  the  first  letters 
are  the  same,  then  we  order  the  two  words  on  the  basis  of  the  second 
letters,  and  so  on. 

A second  useful  application  is  that  lexicographic  ordering  offers 
a method  of  comparing  points  in  the  plane.  The  points  could  be 
compared  by  looking  at  the  first  coordinates,  if  they  are  the  same, 
then  we  compare  second  coordinates.  Therefore,  one  could  say 
(1,4)  < (3,1),  (2,7)  < (2,9),  (1,1000)  < (2,2),  etc. 


If  a set  is  linearly  ordered  by  a relation^,  we  may  consider  an 
additional  property  that  certain  linearly  ordered  sets  have. 


Definition  20.  Let  A be  a set  and  suppose  < is  a linear  ordering 
of  A,  then  A is  well  ordered  if  and  only  if  every  nonempty  subset  of  A 
has  a least  or  smallest  element,  i.e.,  if  for  every  nonempty  subset 
BCA,  there  is  an  element  bQ€  B,  such  that  b0<  b for  every  b€  B. 
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Examples 


1.  The  set  of  all  positive  integers  is  well  ordered  by  <,  because 
every  subset  of  the  positive  integers  has  a smallest  element. 

This  assertion  is  equivalent  to  Peano's  axiom. 

2.  The  set  of  all  integers  is  not  well  ordered  by  because,  for 
example,  ^itself  has  no  smallest  element. 

3.  Clearly  every  finite  set  with  a linear  ordering  defined  on  it  is 
also  well  ordered,  because  there  are  only  a finite  number  of  ele- 
ments to  consider  at  a time,  and  the  smallest  one  may  always  be 
picked  out. 

4.  If  the  set  under  consideration  consists  of  scores  on  an  achievement 
test,  then  these  scores  are  linearly  ordered  by  "less  than  or  equal 
to."  Also  the  set  is  well  ordered,  because  any  subcollection  of 
scores  will  always  have  a lowest  score. 


We  have  completed  our  discussion  of  relations  and  the  special 
properties  of  relations.  We  have  also  examined  equivalence  relations 
and  different  types  of  orderings.  The  richness  of  these  ideas  should 
be  evident  from  the  ease  with  which  they  handle  both  abstract  and  real 
considerations.  Psychologists  have  been  utilizing  these  ideas  in  their 
justifications  of  various  phenomena,  so  it  would  be  reasonable  to  in- 
corporate these  terms  into  the  language  of  psychology  as  a means  of 
precise  description. 


CHAPTER  3 


MAPPINGS 


One  of  the  most  important  ideas  in  all  of  mathematics  is  that  of 
a function  or  mapping.  This  term  is  so  fundamental  that  it  is  in  com- 
mon usage  in  most  disciplines.  Almost  anyone  will  with  great  regularity 
refer  to  one  thing  as  being  a "function"  of  something  else.  In  a very 
narrow  mathematical  sense,  a function  may  be  viewed  as  a formula  that 
associates  to  a number  another  number.  For  example,  according  to  a 
formula  the  numbei  5 may  be  associated  with  the  number  7.  This  is  a 
restricted  definition  of  a function,  and  is  highly  limited  in  terms 
of  its  applicability.  Therefore,  as  a first  definition  of  a function, 
let  us  consider  the  following. 


Definition  21.  A function  or  mapping  f,  from  one  set  U to  another 
set  V,  is  a rule  that  associates  with  each  element  x in  a certain  sub- 
set Df  of  U,  a uniquely  determined  element  f (x)  in  V.  The  set  of  values 
in  Df  is  called  the  domain . The  element  y = f (x)  is  called  the  image  of 
f at  x,  where  xCDf.  The  set  of  all  image  values  of  f is  referred  to 
as  the  range  and  will  be  denoted  by  Rf. 

Even  though  this  definition  is  more  general  than  the  previous  one, 
in  that  the  sets  U and  V do  not  have  to  be  sets  of  numbers,  there  is 
still  an  ambiguity  built  into  the  definition. 

In  mathematics,  as  well  as  in  psychology,  when  dealing  with  ab- 
stract ideas,  it  is  important  to  be  precise  with  one's  language.  In 
the  definition  of  a function  or  mapping  the  key  word  is  rule.  A mapping 
from  U to  V is  a rule,  but  what  is  a rule?  The  definition  is  highly  in- 
tuitive and  will  be  made  use  of  in  the  book,  but  in  order  to  be  as 
rigorous  as  possible,  another  definition  of  a function  will  be  given. 

The  new  definition,  interestingly  enough,  will  be  in  terms  of  the  lan- 
guage introduced  in  the  first  two  chapters. 


Definition  22.  Let  U and  V be  nonempty  sets,  then  a mapping  or 
function  from  CJ  into  V is  a set  f of  ordered  pairs  in  the  Cartesian 
product  U X V,  such  that  if  (x,y)  and  (x,z)  are  elements  of  f,  then 
y = z.  In  other  words,  a mapping  f is  a relation  between  sets  U and  V, 
such  that  for  every  admissible  value  x in  U there  is  a unique  y in  V, 
such  that  (x,y)C  f.  The  collection  of  all  first  components,  denoted 
by  Df,  will  be  called  the  domain.  Therefore,  Dj  is  the  set  of  all 
admissible  values  in  U.  The  range , Rf,  consists  of  all  those  values 
in  V occurring  as  second  components  in  the  ordered  pairs. 
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A function,  then,  is  a special  type  of  relation.  It  is  a subset 
of  the  Cartesian  product  U X V,  with  the  added  condition  that  the 
second  member  of  an  ordered  pair  in  f is  uniquely  determined  by  the 
first  member.  In  order  to  take  advantage  of  the  intuitive  nature  of 
Definition  21,  rather  than  writing  (x,y)£f,  we  will  adhere  to  the 
more  commonly  recognized  notation  of  y = f (x) , and  will  refer  to 
y = f (x)  as  the  image  of  f at  x. 

Examples 

1.  Let  U = {1,2, 3, 4, 5}  and  V = {3,5,9,16,17},  and  define  f = {(1,5), 
(2,3),  (3,17),  (4,16),  (5,9)},  then  fCU  X V,  and  further  for 
every  x€U,  there  is  a unique  y £ V.  Therefore,  f is  a function. 

2.  Let  U = {1,2, 3, 4, 5}  and  V = {3,5,9,16,17}  and  define  f = {(1,5), 
(2,3),  (3,5),  (4,9),  (5,9)},  then  fCU  X V,  and  again  for  every 
xtU,  there  is  a unique  y€.V.  Both  1 and  3 are  associated  with  5, 
but  this  is  not  contrary  to  the  definition  of  a mapping,  since 
each  x£U  still  has  only  one  value  in  V associated  with  it.  Notice 
also  that  in  this  example  the  range  is  {3,5,9}  and  is  not  equal  to 
all  of  V. 

3.  Let  U = {1,2, 3, 4, 5}  and  V = {3,5,9,16,17}  and  define  f = { (1,3) , 
(2,9),  (2,5),  (3,16)}.  f is  a subset  of  U X V,  but  f is  not  a 
function,  since  there  are  two  different  image  values  5 and  9 as- 
signed with  2. 

4.  Suppose  Miss  Nice  is  a second  grade  teacher  in  a small  school  and 
that  she  has  ten  students:  Tom,  Mary,  Bill,  Lola,  Frankie,  Jim, 
Paula,  Farnsworth,  Betty,  and  Tony.  She  gives  them  a spelling  test 
of  20  words  and  makes  a chart  for  the  results  like  the  one  in 
Figure  13.  This  is  an  example  of  a function.  Let 

U = {Tom,  Mary,  Bill,  Lola,  Frankie,  Jim,  Paula,  Farnsworth, 
Betty,  Tony};  and 

V = {0,1,2, ••• ,18,19,20}  = possible  number  of  correct  answers. 

Define  f = {(Tom, 12),  (Mary, 16) , (Bill, 17),  (Lola, 11),  (Frankie, 19) , 
(Jim, 14),  (Paula, 20),  (Farnsworth, 16 ) , (Betty, 15), 

(Tony, 19) }. 

f is  a subset  of  U X V and  also  for  every  element  in  the  domain, 
there  is  a unique  element  in  the  range,  namely  for  each  child 
there  is  a test  score  associated.  The  range  in  the  example  is 
{11,12,14,15,16,17,19,20}. 
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Tom 

12 

Jim 

14 

Mary 

16 

Paula 

20 

Bill 

17 

Farnsworth 

16 

Lola 

11 

Betty 

15 

Frankie 

19 

Tony 

19 

Figure  13 


5.  A function  may  be  thought  of  in  terms  of  a machine.  There  is  an 
input,  an  output,  and  a machine  f performing  the  change.  For  in- 
put x,  f(x)  would  represent  the  output.  Put  a quantity  of  heavy 
cream  in  a blender  f and  the  result  will  be  whipped  cream.  Put  a 
coin  in  a bubble  gum  machine  and  out  comes  a piece  of  bubble  gum. 
The  parallel  to  a machine  is  indicate*'  in  Figure  14. 


f is  the  machine,  f (x)  is  the  output 
Figure  14 


6.  The  idea  of  a function  as  a collection  of  ordered  pairs  seems  to 
indicate  that  it  may  be  helpful  to  consider  a function  in  terms  of 
its  graph.  We  will  do  this  in  a separate  section  at  the  end  of 
the  chapter. 

7.  The  idea  of  a function  may  also  be  given  a geometric  interpretation. 
Consider  the  description  of  a mapping,  f,  in  Figure  15. 


Figure  15 
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8.  There  are  certain  functions  that  are  worthy  of  specific  mention. 

One  of  them  is  the  identity  mapping.  In  effect  an  element  is 
mapped  into  itself,  that  is  the  mapping  does  not  change  anything. 

We  would  write  this  as  f (x)  = x.  For  instance,  f ( 3 ) = 3,  f{*271)  = 
•271,  etc.  The  set  of  values  that  are  left  unchanged  by  a mapping 
are  often  said  to  be  invariant  with  respect  to  the  mapping.  The 
idea  of  invariants  is  valuable  in  psychology.  For  example,  if 

one  understands  what  types  of  transformations  leave  an  entity  or 
concept  unaltered,  then  one  has  a good  understanding  of  what  that 
entity  or  concept  is. 

9.  The  constant  function  is  another  very  basic  mapping.  For  this  map- 
ping, regardless  of  which  element  in  the  domain  is  selected,  the 
function  always  assigns  the  same  range  value.  Examples  of  a con- 
stant function  would  be  f (x)  = 5,  where  regardless  of  what  the  x 
value  is,  it  is  always  assigned  the  value  5.  Another  example  is 

in  a store  where  every  item  costs  the  same  amount,  or  in  a condi- 
tioning experiment,  where  an  animal  is  conditioned  to  always  pick 
the  element  in  the  left  position,  regardless  of  whether  the  ele- 
ments are  balls,  blocks,  colors,  etc. 

10.  In  Scandura's  (1970)  SFL  language  mentioned  before  in  chapter  2, 

the  idea  of  a function  is  basic  to  the  discussion.  He  distinguishes 
between  a rule,  a concept,  and  an  association  as  follows.  A rule 
he  defines  as  a function  whose  domain  is  a set  of  stimuli  and  whose 
range  is  a set  of  responses.  A rule  is  then  a mapping  between 
equivalence  classes  of  stimuli  and  responses.  A concept  is  a 
constant  function,  i.e.,  each  stimulus  in  a class  is  paired  with 
a common  response.  An  association  is  a function  whose  domain  con- 
sists of  one  stimulus  and  whose  range  consists  of  one  response, 
i.e. , an  association  is  a single  S-R  pair. 


11.  Anyone  who  has  debated  whether  it  was  necessary  to  put  an  addi- 
tional stamp  on  a letter  is  familiar  with  the  post  office  func- 
tion. It  is  an  example  of  a mapping  where  the  domain  is  broken 
up  into  several  parts  as  in  Figure  16. 


f (x) 


8*  if  0 < x 
|16*  if  1 < x 
124*  if  2 < x 


< 1 ounce 

< 2 ounces 
i 3 ounces 


etc. 


Figure  16 


12.  Addition  is  another  example  of  a mapping:  Let  ^ be  the  set  of 
integers,  and  define  U : Z X to  be  the  Cartesian  product  of 
the  integers  with  themselves,  i.e.,  U consists  of  all  the  ordered 
pairs  of  integers.  Define  f as  a mapping  from  U into  , and  denote 
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it  be  f:  U-*2,  where  f((m,n))  = m + n,  with  m,n  € ~£_.  There- 
fore, f ( (10,4) ) = 10  + 4 = 14,  f ( (11,3) ) = 11  + 3 = 14,  etc. 


13.  Another  interesting  function  is  called  the  characteristic  function. 
Let  U be  any  set,  and  suppose  S is  a subset  of  U,  then  define 


fs(x) 


This  means  that  if  x €s,  then  the  function  value  is  1,  otherwise 
the  function  is  0.  We  could  think  of  a discrimination  problem  in 
these  terms.  If  the  subject  makes  the  correct  discrimination  he 
receives  a reward,  and  if  he  does  not,  then  he  receives  nothing. 

It  is  just  necessary  to  think  of  1 as  reward  and  0 as  no  reward. 

14.  Sequences  are  used  with  great  frequency  in  psychology.  An  article 
may  refer  to  the  1001  subjects  as  Sq,Si,S2, • • • ,SiqoO'  or  statis- 
tics one  may  be  interested  in  the  multiple  correlation  between 
variables  X^,X2, • • • A sequence  is  a special  case  of  a function 
The  domain  of  the  mapping  consists  of  0,1,2,  ••••,  and  the  range 
consists  of  whatever  is  being  described.  Rather  than  write 
S(0) ,S(1) ,S(2) , • • • • we  write  Sq,S]_,S2»*'**»  but  nevertheless,  a 
sequence  is  a special  case  of  a function. 


We  have  considered  a rather  extensive  list  of  examples  of  func- 
tions. But,  if  one  considers  the  frequency  with  which  the  word  func- 
tion occurs  in  daily  life,  in  addition  to  its  more  technical  uses  in 
the  sciences,  it  is  clear  why  it  is  important  that  the  definition  and 
types  of  functions  be  discussed  in  this  text.  Keep  in  mind  that  a map- 
ping is  a relation,  with  the  added  condition  that  for  each  element  in 
the  domain  there  is  associated  a unique  element  in  the  range. 

We  have  looked  at  examples  where  the  range  was  the  entire  set  V 
and  others  where  Rf$:V.  Those  mappings  that  have  Rf  = V are  of  special 
interest,  and  have  been  given  a special  name. 


Definition  23.  If  f is  a mapping  from  U into  V,  then  f is  said 
to  map  onto  v if  Rf  = V,  i.e. , the  range  of  f is  all  of  V.  This  may 
also  be  stated  as,  f is  a mapping  from  U onto  V if  for  every  y€v, 
there  exists  an  xCDf,  the  domain  of  f,  such  that  (x,y)€  f,  or  equiva- 
lently, y = f(x).  An  onto  mapping  is  also  called  a surjective  mapping 
or  a surjection. 
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1.  Consider  the  first  two  examples  of  functions.  We  were  given  that 
U « 11,2,3,4,5}  and  V » {3,5,9,16,17}.  In  example  1,  the  range 
was  equal  to  the  set  of  elements  3,5,9,16,  and  17.  Therefore,  the 
mapping  is  onto.  But  in  example  2,  the  range  was  only  3,5,  and  9. 
Therefore,  Rf^V,  and  this  function  is  only  a mapping  from  U into 
V,  not  onto  V. 

2.  The  example  of  the  2nd  grade  spelling  test  results  is  a case  of 
another  function  that  is  not  onto  V.  V equals  the  numbers 

0,1, 2, ••*,20,  i.e.,  the  potential  number  of  correct  answers,  but 
the  actual  results  only  were  Rf  = {11,12,14,15,16,17,19,20},  and 
Rf£V. 

3.  If  we  consider  the  identity  function,  and  suppose  the  domain  con- 
sists of  all  the  real  numbers,  i.e.,  all  the  numbers  along  the  num- 
ber line.  Also  assume  that  V is  equal  to  the  real  numbers.  Then 
the  identity  mapping  f (x)  = x is  a mapping  onto  V since  every  real 
number  is  simply  mapped  into  itself. 

4.  If  we  again  consider  the  identity  mapping,  but  suppose  that  U = V = 
£,  2T  recall  is  the  set  of  integers.  Then  f (x)  = x is  a mapping  onto 
V because  every  integer  is  mapped  onto  itself.  However,  if  the 
function  were  f (x)  = 2x,  i.e.,  each  number  is  associated  with 
twice  itself,  then  the  mapping  would  not  be  onto,  because  the  range 
would  consist  of  only  the  even  integers,  and  not  all  of  the  integers 
For  example,  f ( 3 ) = 6,  f(9)  = 18,  etc.  It  is  impossible  to  find  an 
integer  x,  such  that  for  instance  f (x)  = 3,  since  2x  = 3 would  imply 
that  x ■ 3/2,  which  is  not  an  integer. 

5.  If  we  again  let  U = V = ZT,  we  see  that  the  constant  function  is 
not  onto,  since  the  range  of  the  constant  function  is  only  one 
element. 

6.  The  post  office  function  is  not  onto  because  the  price  of  mailing 
letters  is  always  a multiple  of  8<J.  If  the  letter  weighs  too  much, 
another  8C  must  be  put  on  the  letter. 

7.  The  SFL  theory  of  Scandura  defines  a concept  in  terms  of  function 
language.  The  domain  is  a set  of  stimuli,  the  set  V is  a set  of 
responses,  but  the  range  of  a learned  concept  consists  of  only  one 
response,  namely  the  correct  one.  Therefore,  a concept  is  not 
onto. 

8.  On  a true-false  test,  the  domain  consists  of  a set  of  questions  and 
the  answers  are  to  be  selected  from  the  set  V = {T,F}.  If  the 
answers  to  the  set  of  questions  consist  of  both  true  and  false  an- 
swers, then  the  mapping  is  onto;  however,  if  all  the  answers  are 
true  or  all  the  answers  are  false,  then  the  mapping  is  into. 
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9.  A matching  test  (like  the  one  in  Figure  17)  would  be  an  example  of 
an  onto  mapping.  The  function  consists  of  the  following  ordered 
pairs:  (New  York,  Albany),  (Minnesota,  St.  Paul),  (New  Jersey, 

Trenton),  (California,  Sacramento),  (Pennsylvania,  Harrisburg). 


A. 

New  York 

1. 

Sacramento 

B. 

Minnesota 

2. 

Trenton 

C. 

New  Jersey 

3. 

Albany 

D. 

California 

4. 

Harrisburg 

E. 

Pennsylvania 

5. 

St.  Paul 

Figure  17 


There  is  another  important  type  of  function  that  is  useful  is  es- 
tablishing a correspondence  between  two  sets.  These  mappings  are  called 
1 - 1,  or  one  to  one. 


Definition  24.  A function  f is  1-1,  or  one  to  one,  if  for  any 
x.  and  x2  in  Dj,  where  x^  / x2»  then  f(x^)  ^ f(x2).  Equivalently,  if 
fix!)  = f(x2),  then  x^  must  equal  x2.  In  other  words,  no  element  in 
the  range  of  f,  Rf,  may  occur  more  than  once.  A one  to  one  mapping  is 
also  called  an  injective  mapping  or  an  injection. 


Examples 

1.  If  U = {1,2, 3, 4, 5}  and  V = {3,5,9,16,17},  define  f = {(1,5),  (2,3), 
(3,5),  (4,9),  (5,9)}.  This  function  is  not  1-1,  because  both  4 
and  5 are  mapped  into  9,  i.e.,  4 j*  5,  but  f(4)  = f ( 5)  = 9. 

2.  However,  if  f = {(1,5),  (2,3),  (3,17),  (4,16),  (5,9)},  then  P is 
one  to  one. 

3.  The  example  of  a mapping  corresponding  to  the  results  of  a spelling 
test  given  before  is  not  a 1 - 1 mapping,  because  both  Mary  and 
Farnsworth  scored  16. 

4.  The  identity  mapping  from  one  set  to  itself  is  an  obvious  example 

of  a 1 - 1 function.  Since  this  mapping  is  defined  by  f (x)  = x, 
then  trivially  if  x,  ^ x2,  then  f (x  ) f (x  ) , because  f (x  ) « x 
and  f(x2)  » x2.  1 1 11 

5.  The  constant  function  is  1 - 1 only  if  the  domain  consists  of  one 
element;  otherwise  there  are  many  elements  mapped  into  the  same 
element.  Therefore,  a concept  is  generally  not  a 1 - 1 mapping. 
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6.  A true-false  test  generally  is  not  a one  to  one  mapping,  because 
more  than  one  of  the  items  is  true  and  more  than  one  of  the  items 
is  false.  For  example,  in  a five  question  test  it  is  impossible 
to  have  a 1 - 1 mapping. 

7.  A matching  test  is,  however,  1-1,  because  each  answer  corresponds 
to  only  one  question. 


Some  mappings  are  onto,  but  not  one  to  one,  others  are  1-1,  but 
not  onto,  and  there  are  also  mappings  that  are  both  1-1  and  onto. 


Definition  25.  A mapping  f is  a 1-1  correspondence  between  sets 
U and  V if  f is  a 1 - 1 mapping  onto  V.  A 1 - 1 correspondence  is 
also  called  a bijective  mapping  or  bi jection.  Thus,  a mapping  that 
is  an  injection  and  a subjection  is  a bi jection. 


Examples 

1.  The  identity  mapping  is  a 1 - 1 correspondence,  since  we  have  shown 
if  U = V = real  numbers,  then  f (x)  = x is  both  1-1  and  onto. 

2.  The  mapping  f (x)  2x,  where  U ■ V ■ 2^  was  shown  to  be  into,  not 

onto,  but  f(x)  ■ 2x  is  1 - 1 since  if  xj  ft  xj,  then  f(xi>  ft  f(x;i). 
This  follows  because  2xj  / 2xt* 

3.  If  U = (1,2, 3, 4, 5}  and  V = (3,6,9),  then  for  f = ((1,3),  (2,9), 
(3,6),  (4,3),  (5,9)1,  the  function  is  onto,  but  not  1-1,  since, 
for  example,  both  1 and  4 are  mapped  into  3. 

4.  Another  example  of  a 1 - 1 correspondence  would  be  a matching  test. 
We  have  shown  that  this  is  both  a 1 - 1 and  onto  mapping. 

5.  In  any  theory  designed  to  describe  the  human  mind  such  as  automata 
theory,  the  psychologist  hypothesizes  a 1 - 1 correspondence  between 
man  and  the  simulated  model. 


Before  we  begin  a discussion  of  different  operations  between  map- 
pings it  is  a good  idea  to  define  the  equality  of  two  functions. 


Definition  26.  If  f and  g are  mappings  of  U into  V,  the  f equals 
g,  i.e.,  f = g,  if  f(x)  » g(x)  for  every  x€u. 


We  may  define  a sum,  difference,  production,  and  quotient  of  two 
functions  f and  g:  In  other  words  there  exist  methods  of  producing  new 
functions. 
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Definition  27.  Suppose  f and  g are  mappings  from  U into  V,  with 
domains  Df  and  Dg  respectively.  Then  we  make  the  following  definitions 

(i)  (f  + g)  (x)  - f (x)  + g ( x ) ; 

(ii)  (f  - g) (x)  - f (x)  - g(x)j  and 

(iii)  (f  • g)  (x)  - f (x) g (x) . 

In  (i),  (ii)  , and  (iii)  the  domain  of  the  new  function  is  DfODg,  i.e., 
those  elements  common  to  both  domains. 

(iv)  (f/g)  (x)  = , where  x€Dfr\Dq  - (Dq|g(x)  =*  0),  i.e., 

those  elements  in  common  to  Df  and  Dg  with  the  exception  of  the  ele- 
ments in  Dg,  where  g(x)  * 0.  This  way  the  problem  of  division  by  zero 
is  avoided,  and  the  new  function  is  defined  everywhere  on  its  domain. 


Example 


1.  If  f (x)  » x2  + 1 and  g(x)  - x - 4,  and  suppose  the  domain  consists 
of  the  real  numbers,  i.e.,  all  the  numbers  on  the  number  line. 
Then, 


(f  + g)  (x) 
(f  - q)  (x) 
(f  • g)  (X) 

(f/g) (x)  » 


■ f(x)  + g(x)  - (x‘  + 1)  + (x  - 
=*  f ( x ) - g (x)  - (x2  + 1)  - (x  - 
- f(x)g(x)  » (x2  + 1) (x  - 4)  « j 
f(x)  x2  -t-  1 


4)  « x* 
4)  ■ x* 
c3  - 4x' 


g (x) 


- 4' 


where  x j 4. 


+ x - 3; 
- x + 5; 
+ X - 4; 


The  operation  that  will  have  more  psychological  relevance  than  the 
others  is  probably  the  composition  of  functions. 


Definition  28.  Let  f be  a function  with  domain  in  U and  range  in 
V.  Let  g be  a function  with  domain  in  V and  range  in  W.  Then  the  com- 
position gof  is  the  function  from  U into  W,  defined  as 

gof  ■ {(x,z)|there  exists  a y€V  such  that  (x,y)Cf  and  (y,i)eg). 

The  domain  of  gof  consists  of  all  those  x in  U such  that  f (x)  is  in  V, 
and  the  range  consists  of  all  those  g(f(x)). 

A few  examples  may  help  clarify  this  definition.  Notice  that  a 
composition  of  functions  is  a means  of  going  from  one  set  of  entities 
to  another  set,  and  then  from  this  set,  then  going  to  a third  set.  An 
important  warning  to  the  reader  is  that  in  some  textbooks  and  journals 
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gof  is  taken  to  mean  first  applying  g and  then  applying  f.  However, 
in  this  book  gof  will  always  be  understood  to  mean  that  f is  applied 
^rs^»  'an<*  then  g is  applied.  As  will  be  pointed  out,  gof  need  not 
equal  fog,  so  it  is  important  to  determine  which  convention  is  being 
adhered  to  in  the  article  you  are  reading. 


Examples 

1.  Suppose  f is  the  mapping  that  associates  1 yard  with  3 feet,  and 
that  g is  the  rule  that  associates  1 foot  with  12  inches,  then  gof 
is  the  mapping  that  associates  l yard  with  36  inches.  The  domain 
of  gof  is  yards,  and  the  range  is  inches.  For  example,  (gof)  (4 
yards)  = g(f(4  yards))  = g(l2  feet)  = 144  inches. 

2.  Suppose  f(x)  = x2  + 1 and  g(x)  = x - 4,  and  suppose  the  domain  of 
f and  of  g is  the  real  numbers , then 

(gof)  (x)  = g (f  (x) ) = g(x2  + 1)  = (x2  + 1)  - 4 = x2  - 3,  but 
(fog) (x)  = f (g (x) ) = f(x  - 4)  = (x  - 4)2  + 1 = x2  _ 8x  + 17> 

This  is  an  example  of  where  gof  / fog,  since  x^  - 3 / x^  - 8x  + 17 
for  all  x,  except  when  x = 5/2.  Recall  that  for  two  functions  to 
be  equal  they  must  be  equal  for  all  x. 

3.  Suppose  a psychology  class  has  an  examination . Let  f be  the  mapping 
that  assigns  a numerical  score  to  each  student.  Let  g be  the  grade- 
line mapping,  i.e.,  certain  scores  receive  an  A,  others  a B,  and  so 
on.  Then  gof  assigns  each  student  a grade  on  the  test. 

4.  Consider  Harlow's  oddity  problem.  Given  three  objects,  with  one  of 
the  objects  different  from  the  other  two.  The  odd  item  should  be 
selected.  Let  f be  the  function  which  represents  the  decision  as 
to  which  element  is  the  odd  item.  Let  g be  the  function  of  select- 
ing this  item.  Then  gof  is  the  successful  performance  of  an  oddity 
problem  task. 


An  interesting  theorem  regarding  the  composition  of  functions  will 
be  stated  without  proof. 


Theorem.  Let  f be  a function  with  domain  in  0 and  range  in  V. 
Let  g be  a function  with  domain  in  V and  range  in  W.  Then, 

^ f and  g are  each  onto,  then  gof  is  also  onto;  and 
if  f and  g are  each  1-1,  then  gof  is  also  one  to  one. 
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When  we  discussed  1-1  mappings,  we  pointed  out  that  there  were 
no  elements  in  the  range  occurring  more  than  once,  i.e.,  if  f(x^)  - 
f(x2>,  then  x^  * X2.  It  may  then  be  observed  that  if  the  ordered  pairs 
constituting  the  function  f have  their  first  and  second  entries  inter- 
changed, then  this  new  set  of  ordered  pairs  would  also  describe  a func- 
tion. Because  of  the  1-1  nature  of  f there  is  correspondence  between 
a domain  element  and  a range  element,  or  conversely  a matching  of  one 
element  in  the  range  with  one  element  in  the  domain.  The  function  ob- 
tained upon  this  interchange  of  components  is  called  the  inverse  of  f. 


Definition  29.  Let  f be  a 1 - 1 function  from  1)  into  V:  If  f 
is  defined  as  f-^  - t(y,x)  |(x,y)£  f ),  then  f-1  is  a 1 - 1 function  from 
V into  U and  is  called  the  inverse  of  f. 


Examples 

1.  If  U * l Tom,  Betty,  Bill,  Sally,  Peter)  and  V « (18,17,20,15,16) 
represents  their  respective  scores  on  a 20  question  test,  then  f 
is  a mapping  from  U onto  V such  that  f = ((Tom, 18),  (Betty, 17), 
(Bill, 20),  (Sally, 15),  (Peter, 16)).  f is  a 1 - 1 mapping,  there- 
fore the  inverse  function  f“l  may  be  defined.  f“l  * ( (18, Tom) , 

(17, Betty),  (20, Bill),  (15, Sally),  (16, Peter)).  Here,  each  score 
is  associated  with  a particular  person,  rather  than  assigning  for 
each  person  a particular  score. 

2.  Consider  the  matching  test  in  Figure  18  which  was  introduced  earlier 
in  the  chapter.  We  have  already  shown  that  this  is  a 1 - 1 mapping. 
Therefore,  an  inverse  exists.  If  f * ((New  York .Albany ) , (Minnesota 
St.  Paul),  (New  Jersey .Trenton) , (California , Sacramento) , (Penn- 
sylvania,Harrisburg)  ) , then  f-1  =>  ( (Albany, New  York),  (St.  Paul, 
Minnesota) , (Trenton, New  Jersey) , (Sacramento, California) , (Harris- 
burg , Pennsylvania) ). 


A. 

New  York 

1. 

Sacramento 

B. 

Minnesota 

2. 

Trenton 

C. 

New  Jersey 

3. 

Albany 

D. 

California 

4. 

Harrisburg 

E. 

Pennsylvania 

5. 

St.  Paul 

Figure  18 


3.  If  f (x)  « 2x,  then  f is  a 1 - 1 mapping.  We  may  show  this  easily; 
if  f (xx)  » f (X2> , i.e.,  2x^  « 2x2i  then  this  implies  xj  - x2.  or 
f is  1 - 1.  If  f is  defined  as  y - 2x,  then  x - y/2  would  define 
the  inverse  function  f“l.  For  every  y value,  the  x value  is  one 
half  of  this  y value. 
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The  ideas  of  the  composition  of  functions,  a 1 - 1 correspondence, 
and  an  inverse  of  a function  may  be  connected  by  means  of  a useful 
theorem  that  will  now  be  stated. 

Theorem.  The  mapping  f from  U into  V is  a 1 - 1 correspondence, 
i.e.,  a 1 - 1,  onto  mappinq  if  and  only  if  there  exists  a mappinq  f“l 
from  V into  U such  that  f“lof  and  fof“l  are  the  identity  mappings  on 
U and  V respectively , i.e.,  (f-1of)  (x)  = f— 1 (f  (x) ) = f~My)  - x and 
(fof-1) (y)  = f(f-1(y))  - f (x)  « y. 


Examples 

1.  In  other  words,  if  a function  and  its  inverse  are  consecutively 
applied,  one  ends  up  where  one  started.  If  an  individual  travels 
from  New  York  to  Boston  and  then  from  Boston  to  New  York,  he  ends 
up  where  he  started.  The  person's  trip  may  be  described  as 

f (New  York)  = Boston 
f-1  (Boston)  *=  New  York, 

then  (f-1of)(New  York)  = f-1(f(New  York))  = f-1 (Boston)  = New  York, 
or  (fof-1) (Boston)  = f (f-1 (Boston) ) = f (New  York)  « Boston,  which 
would  describe  the  trip  from  Boston  to  New  York  and  then  a return 
to  Boston. 

2.  Another  example  would  be  if  we  define  y = f (x)  * 2x.  We  have  al- 
ready proven  that  f is  1 - 1.  The  inverse  function  was  shown  to 
be  x « f-1(y)  = y/2.  Then,  (f_1of) (x)  * f-1(f(x))  = f_1(y)  « x 

and  specifically  this  is  (f-1of) (x)  * f-1(f(x))  = f-1 (2x)  - f-1 (y)  = 
x.  Similarly,  (fof-1) (y)  « y. 

We  conclude  this  chapter  with  an  elementary  discussion  of  graphing 
techniques,  and  to  illustrate  these  procedures  wo  will  graph  some  of 
the  functions  described  in  this  chapter. 

Our  examination  of  graphing  will  be  on  a rectangular  coordinate 
system,  which  has  two  axes,  a horizontal  one  called  the  x axis  and  a 
vertical  one  called  the  y axis.  Any  point  in  the  plane  may  be  located 
in  this  system.  The  directed  distance  along  the  horizontal  from  the 
point  of  intersection  of  the  axes  called  the  origin  is  referred  to  as 
the  x coordinate  or  the  abscissa.  The  directed  distance  along  the  ver- 
tical is  called  the  y coordinate  or  ordinate ■ The  abscissa  and  ordinate 
of  a point  are  indicated  by  an  ordered  pair  called  the  coordinates  of  a 
point.  The  graphical  representation  of  the  following  ordered  pairs, 
(7,3),  (-2,4),  (5,1/2),  (-1,-4),  (2,-1),  is  illustrated  in  Figure  19. 
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Figure  19 


The  connection  between  a function  and  its  graph  should  be  clear. 
The  function  consists  of  all  those  ordered  pairs  or  points  indicated 
in  the  graph.  In  other  words,  every  point  satisfying  a function  lies 
on  the  graph  of  the  function,  and  conversely,  every  point  on  the  graph 
and  only  those  points  are  points  that  satisfy  the  function.  That  is, 
there  is  a 1 - 1 correspondence  between  those  points  satisfying  a 
function,  and  the  points  of  the  graph  of  the  function. 


Examples 

{1,2, 3, 4, 5}  and  V = {3,5,9,16,17}  and  define  f = {(1,5), 
(3,17),  (4,16),  (5,9)}.  This  function  is  graphed  in  Fig- 


Figure  20 


{1,2, 3, 4, 5}  and  V = 
(3,5),  (4,9),  (5,9)}. 


{3,5,9,16,17}  and  define  f = {(1,5), 


Figure  21  illustrates  the  graph  of 
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CHAPTER  4 


GROUPS 


A class  of  algebraic  entities  useful  in  psychology  is  groups.  The 
presentation  on  groups  will  be  made  in  two  chapters.  The  first  chapter 
includes  a discussion  of  the  definition  of  a group  and  the  related 
terms  of  groupoid,  semigroup,  and  monoid.  Elementary  examples  from 
mathematics  are  included  to  illustrate  the  relevant  terminology.  The 
use  of  multiplication  tables  for  finite  groups  will  be  explained,  and 
then  used  in  the  verification  of  certain  sets  as  groups.  To  gain  famil- 
iarity with  the  new  concepts  a number  of  direct  consequences  will  be 
proven.  Other  key  terms  such  as  subgroup,  generators,  and  different 
types  of  mappings  such  as  homomorphism,  isomorphism,  and  automorphism 
will  be  introduced  and  the  chapter  will  be  concluded  with  an  examination 
of  several  important  examples,  or  types  of,  groups. 

The  second  chapter  will  be  concerned  with  the  application  of  groups 
to  psychology.  Examples  will  be  given  from  Piagetian  theory,  the  theory 
of  kinship  relations,  the  studies  of  measurement,  perception,  language, 
automata  theory,  habit  family  hierarchies,  cross-context  matching,  sym- 
metric choice  experiments,  and  the  use  of  groups  in  the  application  of 
parallel  tasks. 

We  now  define  a group.  First,  a group  is  more  than  a set  of  ele- 
ments. It  is  a set  for  which  there  is  defined  an  operation  such  that 
certain  properties  are  satisfied. 

Definition  30.  A group  is  a nonempty  set  of  elements  G together 
with  an  operation  * defined  on  ordered  pairs  of  elements  in  G,  such 
that  the  following  four  properties  are  satisfied. 

(i)  For  every  a,b£G,  the  element  a*b€G,  i.e. , the  product  of 
any  two  elements  a and  b in  the  set  G gives  an  element  a*b 
that  is  also  in  the  set  G.  This  property  is  called  closure. 

(ii)  For  every  a,b,c^G,  (a*b)*c  = a*(b*c),  i.e.,  whether  we 

first  perform  the  operation  (a*b)  and  then  combine  it  with 
c,  or  if  we  first  perform  b*c,  and  then  combine  a with  b*c, 
the  final  outcome  is  the  same.  This  property  is  referred 
to  as  the  associative  property. 

(iii)  For  every  a€G,  there  exists  an  element  eCG,  such  that 

a*e  = e*a  = a,  i.e.,  there  exists  an  element  e,  such  that 
regardless  of  which  element  of  G is  considered,  when  e is 
combined  with  that  element,  the  element  is  unchanged,  or 
in  other  words,  is  identical  to  the  way  it  was  before  the 
operation  was  performed.  This  element  e is  called  the 
identity  element. 
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(iv)  For  every  a£G,  there  exists  an  element  a_1£G,  such  that 

a*a~l  = a-l*a  = e,  i.e.,  for  every  element  in  G there  exists 
an  element  a-1  such  that  when  the  two  are  combined,  the  re- 
sultant product  is  the  identity  element.  This  element  a--1- 
is  called  the  inverse  element. 

Recapitulating,  a group  is  a nonempty  set  of  elements  G together 
with  an  operation  *,  such  that  G is  closed,  associative,  has  an  identity 
element,  and  every  element  in  G has  an  inverse.  A group  is  an  example 
of  a mathematical  system.  Actually  a group  G should  be  written  as  (G,  *) 
to  indicate  that  it  is  a set  of  elements  and  a specific  operation,  but 
for  simplicity  of  notation  a group  will  be  written  as  G.  The  reader 
should,  however,  also  remember  that  the  operation  is  implicitly  under- 
stood. Certain  sets  when  combined  with  particular  operations  will  satis- 
fy only  some  of  the  properties.  We  give  names  to  specific  subcollections 
of  the  four  properties. 

Definition  31.  A groupoid  is  a nonempty  set  G together  with  an 
operation  *,  that  has  closure,  i.e.,  for  any  a,b€G,  than  a*b  is  also 
an  element  of  G. 

Definition  32.  A semigroup  is  a nonempty  set  G together  with  an 
operation  * , that  satisfies  the  closure  and  associative  properties. 

In  other  words,  a semigroup  is  an  associative  groupoid. 

Definition  33.  A monoid  is  a nonempty  set  G together  with  an  oper- 
ation *,  that  satisfies  the  closure  and  associative  properties,  and 
further  has  an  identity  element.  That  is,  a monoid  is  a semigroup  that 
has  an  identity  element. 

There  is  one  more  important  property  concerning  groups,  or  for 
that  matter  groupoids,  semigroups,  and  monoids.  The  commutative  prop- 
erty is  not  a requirement  of  being  a group,  but  it  is  very  important 
in  a discussion  of  groups.  As  will  become  evident  in  the  examples  of 
the  following  pages,  it  is  not  always  possible  to  interchange  the  order 
of  combining  two  elements  and  obtain  the  same  element.  We  earlier  saw 
that  the  composition  of  two  functions  f and  g gave  different  results 
in  considering  fog  and  gof. 

Definition  34.  The  operation  * defined  on  the  set  G is  said  to 
be  commutative  or  abelian  if  for  every  a,b€.G,  a*b  = b*a.  Therefore, 
a group  satisfying  the  added  property  that  a*b  = b*a  for  every  a,b  in 
G,  is  called  a commutative  or  abelian  group.  Similarly,  an  abelian 
groupoid,  semigroup,  or  monoid  could  be  defined. 

We  will  encounter  groups  that  have  a finite  number  of  elements  and 
others  that  have  an  infinite  number.  Naturally,  the  question  of  how 
many  elements  are  in  a group  is  more  interesting  in  the  finite  case. 

Definition  35.  The  order  of  a group  G,  denoted  o(G)  or  G is 
the  number  of  elements  in  the  group. 
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In  the  case  of  finite  groups  a multiplication  table  may  be  made 
to  indicate  all  the  possible  products.  Suppose  the  group  G is  defined 
as  G » (X1 »x2 , • • • , xn) . List  the  elements  x^ ,X2 , • • • ,xn  across  the  upper- 
most row  and  down  the  farthest  left  column,  as  in  Figure  27.  The  ele- 
ment appearing  in  the  ith  row  an<j  the  jth  column  would  be  the  element 
xj.  * xj , which  equals  some  x^  in  G,  since  G is  a group,  and  is,  there- 
fore, closed.  We  will  make  use  of  the  multiplication  table  in  some  of 
the  examples. 


X,  X_  . . . X.  x. 
12  in 


Figure  27 


Examples 


1.  Suppose  that  the  set  G equals  the  elements  1 and  -1,  and  the  opera- 
tion is  multiplication.  A table  of  the  products  is  shown  in  Fig- 
ure 28. 


• 1 -1 


11-1 
-1  -1  1 


Figure  28 


(i)  G is  closed,  because  every  product  is  1 or  -1. 

(ii)  G is  associative,  because  with  multiplication  it  does  not 
matter  which  way  the  elements  are  grouped. 

(iii)  G has  an  identity  element,  namely  the  element  1,  because 
1*1  =*  1 and  (-1)  • 1 = -1. 


(iv)  Each  element  has  an  inverse;  in  fact,  each  element  is  its 
own  inverse;  1*1  » 1 and  (— 1) * ( — 1)  - 1. 

Therefore,  G is  a group,  and  G is  actually  an  abelian  group  since 
the  order  of  multiplication  does  not  matter. 

Let  £ be  the  integers,  i.e.,£!«  { ‘ ' ’ , -2 , -1 ,0, 1 ,2 . * • • } and  let  the 
operation  be  addition.  2.  is  an  abelian  group.  The  sum  of  any  two 
integers  is  another  integer;  therefore,  2!L  is  closed.  ^ is  associa- 
tive, because  for  a,b,c£2,  (a+b)  + c = a + (b+c)  . The  identity 
element  is  0,  because  any  integer  plus  0 is  still  the  same  integer. 
The  inverse  of  an  integer  a is  -a,  since  a + (-a)  » 0.  For  example 
the  inverse  of  3 is  -3.  Finally,  G is  abelian,  since  a + b «•  b + a 

If  the  set  was  changed  to  be  the  natural  numbers  or  counting  num- 
bers, N = 11,2,3,  •••},  then,  if  the  operation  is  again  addition, 

N is  an  abelian  semigroup.  It  has  no  identity,  because  Of  N. 

Also,  since  the  negative  integers  are  not  included,  there  are  no 
inverses.  If  we  consider  5€N,  the  inverse  would  have  to  be  -5, 
but  -5^N. 

If  we  modify  the  set  of  natural  numbers  by  adding  the  element  0, 
then  the  set  under  consideration  is  G <*  (0,1,2,* ••}.  This  set  is 
an  example  of  a commutative  monoid  under  addition,  since  0 is  the 
identity  element. 

In  considering  the  set  of  natural  numbers,  but  now  with  the  opera- 
tion of  subtraction,  it  may  be  observed  that  the  set  is  not  even 
closed.  If,  for  example,  we  consider  the  natural  numbers  5 and  9, 

5 - 9 = -4,  but  -4  is  not  a natural  number.  The  reader's  immediate 
reaction  may  be  to  ask,  suppose  instead  of  the  natural  numbers,  we 
considered  the  integers  with  the  operation  of  subtraction.  We 
still  would  not  be  able  to  get  a group,  because  the  associative 
property  does  not  hold.  For  instance,  if  we  consider  15,  8,  12, 
notice  that  (15  - 8)  - 12  ■ 7 - 12  « -5,  but  15  - (8  - 12)  ■=  15  - 
(-4)  = 19  and  -5  / 19.  Neither  is  there  an  identity  element.  It 
is  true  that,  for  example,  5-0=5,  but  0 - 5 «=  -5  and  -5  is  not 
equal  to  5.  Recall  that  the  identity  property  required  that  a*e  = 
a.  Therefore,  we  have  an  example  of  a groupoid. 

Perhaps  your  curiosity  is  aroused  as  to  what  would  happen  if  we 
looked  at  the  integers  together  with  the  operation  of  multiplica- 
tion. Closure,  associativity,  and  the  existence  of  an  identity, 
namely  e = 1,  are  all  complied  with,  however,  1 and  -1  are  the 
only  elements  that  have  an  inverse.  If  we  consider  6 as  an  element 
of  the  integers,  the  inverse  of  6 is  1/6  since  6 • 1/6  = 1,  but 
1/6  is  not  an  integer. ^ This  set  is  then  a monoid  under 
multiplication. 
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If  we  would  enlarge  our  set  to  the  rational  numbers  and  again 
consider  the  operation  of  multiplication,  we  then  may  observe  that 
we  have  an  abelian  group.  The  rational  numbers  are  the  set  con- 
sisting of  all  fractions.  A whole  number  is  a special  case  of  a 
fraction,  e.g.,  3 = 3/1.  Therefore,  the  integers  are  contained  in 
the  rational  numbers.  The  only  property  in  question  would  be  the 
inverse,  but  with  the  inclusion  of  fractions  in  our  set,  the  in- 
verse of  a fraction  is  just  its  reciprocal  which  again  is  a frac- 
tion. The  inverse  of  3 is  1/3,  the  inverse  of  5/8  is  8/5,  etc. 

The  next  example  is  used  to  illustrate  that  for  the  same  set  G * 
(e,a,b,c)  (see  Figure  29)  we  may  indicate  multiplication  tables  of 
two  distinct  groups. 

(i)  e a b c 

e e a b c 

a a e c b 

b b c a e 

c | c b e a 

Figure  29 

It  is  a group.  Clearly  there  is  closure,  the  identity  is  e,  and  the 
inverse  of  e is  e,  of  a is  a,  of  b is  c,  and  of  c is  b.  The  associa 
tivity  requires  verification,  left  to  the  reader.  For  example 
a* (b*c)  = a*e  = a and  (a*b) *c  = c«c  = a;  therefore,  a*(b*c)  = 
(a*b)*c.  The  other  products  of  this  type  should  be  examined. 


(ii)  e a b c 

e e a b c 

a a e c b 

b b c e a 

c c b a e 

Figure  30 


Figure  30  describes  a group.  In  this  example  each  element  is  its 
own  inverse . 


Example  (i)  is  an  example  of  a cyclic  group  and  a more  de- 
tailed discussion  of  cyclic  groups  will  be  given  at  the  end  of 
the  chapter.  Example  (ii)  is  usually  referred  to  as  the  "4-group." 
The  discussion  of  Piaget's  INRC  group  (Piaget  & Inhelder,  1958) 
will  be  based  on  the  "4-group,"  and  will  occur  in  the  next  chapter 
as  an  application  of  groups  to  psychology. 

9.  Consider  a square,  and  observe  that  the  center  of  the  square  is 

the  point  at  the  intersection  of  the  diagonals  of  the  square.  Let 
the  set  G consist  of  the  rotations  of  the  square  around  its  center 
through  90°,  180°,  270°,  and  360°  in  the  clockwise  direction.  De- 
note these  rotations  by  Rgo°#  R180°'  R270°'  R360°'  respectively. 
Define  A*B  to  be  the  rotation  A followed  by  the  rotation  B.  For 
example,  R^8q°  * R270°  = R900  • because  R4500  “ R900 • The  multipli- 
cation table  for  G is  given  in  Figure  31.  Notice  that  R-j60©  *s 
the  identity  rotation  and  the  inverse  of  any  particular  rotation 
is  that  rotation  needed  to  complete  a 360°  rotation.  G is  a group 
and  if  one  compares  Example  8(i)  with  this  example  with  the  corre- 
spondence of  e with  r35o°'  b w^bb  Rg0° » a with  R^qqo , and  c with 
R270O , one  sees  that  they  are  essentially  the  same  group.  Notice 
further  that  90°,  180®,  270°,  and  360°  were  chosen  for  the  square 
because  these  rotations  leave  the  vertices  or  corners  in  the  same 
positions.  In  the  case  of  a triangle  these  invariant  rotations 
would  be  120°,  240°,  and  360°. 
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Figure  31 


10.  A related  but  more  complicated  example  that  has  geometric  and  visual 
significance  is  that  of  the  group  of  the  symmetries  of  a square. 
Consider  a square,  and  it  may  not  be  a bad  idea  to  actually  use  a 
square  piece  of  paper  to  aid  in  the  verification.  Impose  a coordi- 
nate system  on  the  piece  of  paper  with  the  origin  at  the  intersec- 
tion of  the  diagonals  of  the  square  and  the  sides  of  the  square 
parallel  to  the  coordinate  axes.  A sketch  of  the  situation  is 
given  in  Figure  32.  Let  the  set  under  consideration  consist  of 
eight  motions  of  the  square.  These  motions  are  all  rigid,  i.e., 
the  square  is  not  in  any  way  distorted  or  folded  or  squashed. 
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Further,  notice  that  each  motion  is  such  that  the  square  always 
coincides  with  its  initial  position  after  any  one  of  the  motions. 
Let  the  first  four  motions  be  clockwise  rotations  of  the  square 
through  90°,  180°,  270°,  and  360°.  Denote  these  motions  by 
Rgo**  r180"'  r2708'  and  R360° ' respectively. 


Figure  32 


Let  X represent  the  reflection  of  the  square  around  the  x 
axis,  and  let  Y represent  the  reflection  of  the  square  around 
its  y axis.  Let  D3  represent  the  reflection  of  the  square  around 
the  diagonal  going  from  the  upper  left  corner  to  the  lower  right 
corner.  Finally,  let  D2  be  the  reflection  of  the  square  around 
the  diagonal  going  from  the  lower  left  corner  to  the  upper  right 
corner.  Therefore,  G = {Rg0° * R180° ,R270° 'R360° »X'Y'D1 »D2 ) • De- 
fine A*B  to  mean  perform  motion  A and  then  motion  B on  the  square. 
For  example,  di*R180o  would  mean  reflect  the  square  around  the 
diagonal  going  from  the  upper  left  to  lower  right  and  then  rotate 
through  180°.  The  result  in  this  case  would  be  D2.  The  completion 
of  the  multiplication  table  may  be  greatly  simplified  by  using  a 
square  piece  of  paper  with  the  numbers  1,2,3,  and  4 in  the  corners 
on  both  sides  of  the  paper.  Perform  the  indicated  motions  and 
determine  what  new  motion  is  obtained.  From  Table  2 it  may  be 
verified  that  G is  a group,  but  not  an  abelian  group. 


The  identity  element  is  R3go°'  and  also  observe  that  Rqq°  and 
R270°  are  eac^  other's  inverses.  Otherwise  the  other  six  elements 
are  self  inverses,  i.e.,  RJ8o°  = R§60°  = 3(2  = Y2  = D^  = D^  = R360° 
identity  element.  In  general,  groups  of  the  symmetries  of  regular 
(equal  sided)  n sided  polygons  are  called  dihedral  groups. 


11.  Let  G be  the  collection  of  all  subsets,  which  is  also  often  called 
the  power  set,  of  some  set  S.  Define  an  operation  * on  G,  where 
A*B  = (A  - B) U (B  - A) , i.e.,  * is  the  symmetric  difference  opera- 
tion discussed  in  the  first  chapter.  Recall  that  we  proved 
A 4 B * B 4 A in  Chapter  1,  i.e.,  A,  the  symmetric  difference,  is 
commutative.  The  closure  of  * (or  A)  is  obvious.  The  identity 
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element  is  the  null  or  empty  set,  because,  for  every  ACS,  A*$  - 
(A  - $)  U (<J>  - A)  » AU  4>  * A.  By  the  commutative  property  <)>*A 
also  equals  A.  The  inverse  of  any  set  A is  A itself,  because 
A* A = (A  - A)  U (A  - A)  = $ U<|>  = 4>.  The  only  property  that  re- 
mains to  be  demonstrated  is  the  associative  property,  i.e.,  that 
for  arbitrary  sets  A,  B,  and  C in  S,  (A*B)*C  = A*(B*C).  The  veri- 
fication gets  quite  messy,  and  requires  more  computational  exper- 
tise than  would  be  expected  of  the  reader.  Observe  that  (A*B)*C 
= [ (A*B)  - C]U[C  - (A*B)  ) = [ ((A  - B)  U (B  - A))  - C]  U (C  - 
((A  - B) U (B  - A))]  and,  A* (B*C)  = [A  - (B*C)  ] U [ (B*C)  - A]  = 

[A  - ( (B  - C)  U (C  - B) ) ] U [ ( (B  - C)  U (C  - B) ) - A]  and  these  two 
expressions  must  be  proven  to  be  the  same.  As  a means  of  intuitive 
justification,  but  not  an  actual  proof,  the  problem  will  be  con- 
sidered in  terms  of  Venn  diagrams  in  Figure  33.  Therefore,  we  have 
an  abelian  group.  This  particular  group  will  be  used  by  Bart 
(1971)  in  his  discussion  of  Piaget's  model  of  formal  operations, 
and  how  that  model  may  be  generalized,  which  follows  in  the  next 
chapter. 


Figure 
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Before  we  begin  to  examine  several  useful  consequences  of  the  con- 
cept group,  a small  table  is  included  reviewing  the  examples  concerning 
the  integers  and  rational  numbers  with  the  operations  of  addition,  sub- 
traction, and  multiplication.  Table  3 indicates  that  a particular  set 
may  be  a group  under  one  operation  but  not  another,  or  that  a particu- 
lar operation  imposes  a group  structure  on  some  sets  but  not  on  all 
sets. 


Consequences 

In  this  section  we  include  some  direct  consequences  of  the  defini- 
tion of  a group. 


Lemma.  If  G is  a group,  then  the  identity  element  is  unique. 

Proof:  We  must  show  that  if  there  are  two  elements  e and  s such 
that  e*a  = a*e  = a and  a*s  = s*a  = a for  every  aCG,  then  e and  s are 
equal,  i.e.,  there  is  only  one  identity  element.  If  e is  an  identity 
element,  then  e*a  = a for  any  afG.  But  s is  an  element  of  G,  there- 
fore, e*s  = s.  If  s is  an  identity  element,  then  a*s  = a for  any  a€  G 
In  particular,  since  e€G,  e*s  = e.  Thus,  we  have  shown  that  e*s  = e 
and  e*s  = s,  from  which  we  may  conclude  that  e = s. 


Lenuna.  If  G is  a group,  then  every  element  a in  G has  a unique 
inverse. 

Proof:  Suppose  that  there  exist  elements  a-1  and  b in  G such  that 
a*a  = a *a  *>  e and  a#b  = b*a  = e , we  must  prove  that  a-1  = b. 

a_1  = a-1*e,  because  any  element  combined  with  the  identity  is 
itself.  Therefore,  by  substitution,  a-1  = a_l*(a*b),  since  we  have 
assumed  a«b  * e.  By  the  associativity  of  *,  a-1  = (a_1*a)*b  = e*b  * b. 
Hence,  a~l  = b and  the  inverse  of  a is  unique. 


There  are  several  other  basic  results  that  we  state  without  proof. 
They  may  be  in  an  introductory  text  in  abstract  algebra  such  as  Her- 
stein  (1964),  Dean  (1966),  or  Burton  (1965). 


Lemma.  (i)  If  G is  a group,  then  for  every  a^G,  a = (a-1)-1, 
i.e.,  the  inverse  of  the  inverse  itself  is  the  element  you  began  with. 

, . (ii)  If  G is  a group,  then  for  any  a,b€G,  <a*b)-1  = 

b“A*a-1,  and  if  G is  abelian,  then  (a*b)"l  = a-1*b~l. 


We  conclude  this  section  with  a typical  group  theoretic  exercise. 


Table 


Theorem.  If  G is  a group,  satisfying  the  property  that  u*l) 2 » 
a *b  for  all  a,b  in  G,  then  G is  an  abelian  group. 

_ W®  mU8t  Sh°w  that  for  every  a'b€-G,  a*b  * b*a , which  would 

establish  that  G is  commutative.  By  hypothesis,  a2*b2  = (a*b)2,  where 

the  operation  is  understood  to  be  V If  a2b2  = (ab)2,  then  since 

a J.ab^'  we  bave  a2b2  “ (ab)(ab).  Upon  multiplying  both  sides 
?f-?h?weqUfllty  by  a_1,  have  a_la2b2  - a-l(ab)(ab),  or  a'laabb  = 

(a  a) b (ab)  by  use  of  the  associativity.  Therefore,  we  obtain  eabb  = 
or  = hah-  Next  multiply  on  both  sides  by  b"l,  to  obtain 
abbb  “ babb'i,  from  which  we  conclude  that  a be  = bae,  or  ab  = ba, 
i.e.,  G is  abelian. 


Subgroups 

After  we  introduced  the  idea  of  a set,  we  followed  it  up  with  an 
examination  of  subsets.  We  will  analogously  now  introduce  the  idea  of 
a subgroup. 

^ 36-  A subset  H of  a group  G,  is  said  to  be  a subgroup 

o G,  if  H itself  is  a group  under  the  same  operation  * that  is  defined 
on  G. 


Examples 

1.  Under  addition  we  have  shown  that  both  the  integers  and  rational 
numbers  are  groups.  Therefore,  the  integers  and  rationals  could 
be  considered  as  H and  G,  respectively,  in  the  above  definition, 
and  we  may  say  that  the  integers  are  a subgroup  of  the  rationals 
under  addition.  Notice  that  if  the  operation  were  multiplication, 
the  integers  would  not  form  a group,  and  thus  would  not  be  a 
subgroup. 

2.  In  our  discussion  of  the  square,  we  first  considered  the  set, 
{Rgo°r  r1808'  r270°»  r360°}  and  proved  it  was  a group.  Next  we 
examined  {R90®,  R180°,  R270°»  R360°'  x*  Dlf  D2 } and  proved  that 
it  too  was  a group.  Hence,  the  set  of  rotations  would  be  a sub- 
group of  the  set  of  motions. 


On  first  inspection  it  would  appear  that  in  order  to  prove  that  a 
subset  H of  a group  G is  a subgroup,  i.e.,  is  actually  a group  itself, 
it  appears  that  the  set  H must  be  tested  for  the  four  basic  properties. 
Actually  the  situation  is  simpler  than  this.  Since  the  associative 
property  holds  for  the  larger  set  G it  certainly  holds  for  H.  There- 
fore, the  associativity  does  not  have  to  be  verified.  Two  lemmas  will 
be  stated  that  indicate  what  must  in  actuality  be  tested. 
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Lemma.  A subset  H of  a group  G is  a subgroup  of  G if  and  only  if, 
(i)  a,b£H  imply  that  a*b£Hi  and 
(ii)  aCH  implies  that  a H. 

By  combining  (i)  and  (ii)  the  existence  of  the  identity  element 
may  be  demonstrated.  Suppose  aCH,  then  be  (ii)  a~^€H,  but  by  (i)  we 
have  a€  H and  H implies  that  a*a-1  * e is  also  in  H.  In  the  case 

of  a group  of  finite  order,  i.e.,  H has  only  finitely  many  members,  the 
verification  is  even  easier. 


Lemma . If  G is  a finite  group,  and  H is  a subset  of  G,  then  H is 
a subgroup  if  H is  closed  under  the  operation  of  G,  i.e.,  if  a,b£  H, 
then  a*b£.H. 


Suppose  we  consider  a group  G,  and  G has  subgroups  H and  K.  The 
question  may  be  posed,  is  HflK  a subgroup  of  G?  The  answer  is  yes  but 
the  question  still  remains,  why? 


Theorem.  If  G is  a group  and  H and  K are  subgroups  of  G,  then 
HOK  is  also  a subgroup  of  G. 

Proof:  H/^iK  is  nonempty  because  e£HOK,  since  e£H  and  e£  K. 

Now,  suppose  x and  y are  elements  of  HOK,  we  must  show  x*y£HoK.  The 
fact  that  x €7 HOK  implies  x is  an  element  of  H and  of  K,  similarly 
y£H  and  y€  K.  Because  H and  K are  subgroups,  x£H  and  y£H  imply 
x*y£H,  and  xeK  and  y£K  imply  x*y£K,  but  x*ye  H and  x*y€  K together 
imply  x*yCHOK.  Secondly,  if  x£HOK,  we  must  show  that  x'^C  HOK. 
x £ HOK  implies  x£TH  and  x£K,  but  the  fact  that  H and  K are  subgroups 
implies  x_^£H  and  x“l£K,  from  which  deduce  x-1£  HOK.  Therefore, 

HOK  is  a subgroup  by  the  stated  lemma. 


A useful  result  concerning  subgroups  is  called  Lagrange's  Theorem 
for"tinite  groups. 


Lagrange 1 s Theorem.  If  G is  a finite  group  and  H is  a subgroup  of 
G,  then  the  order  of  the  group  |g|  is  a multiple  of  the  order  of  the 
subgroup  | H j . 

For  example,  if  a group  has  eight  elements,  then  there  can  be  no 
subgroup  of  three  elements.  Be  cautious  in  applying  the  theorem.  Just 
because  a group  of  eight  elements  has  a particular  subset  of  four  ele- 
ments, it  does  not  imply  that  this  set  is  a subgroup.  What  the  theorem 
guarantees  is  that  if  H is  a subgroup  of  G,  then  the  number  of  elements 
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in  H must  divide  the  number  of  elements  in  G.  In  other  words,  this 
theorem  is  a necessary,  but  not  sufficient,  condition  for  being  a 
subgroup. 


GENERATORS 

A concept  related  to  the  ideas  of  groups  and  subgroups  is  that  of 
generators.  It  would  be  most  desirable  if  the  group  could  be  produced 
by  considering  a subset  of  the  elements  of  the  group  in  various 
combinations. 


Definition  37.  Let  G be  a group,  and  suppose  S = {gi,’**,gN)  is 
a subset  of  G,  such  that  all  the  elements  in  G may  be  produced  as 
products  involving  only  the  elements  in  S,  then  we  call  the  elements 
of  S the  generators  of  G. 


Definition  38.  Let  G be  a group  and  suppose  that  there  is  a single 
generator  a,  i.e.,  G = { a 1 i = 0,.il, ••••},  or  in  other  words,  for  every 
xC  G,  there  exists  an  integer  n such  that  x = a “ (a»a;  • • «a..  G is  written 

n times 

as  G = (a) , and  G is  called  a cyclic  group  with  generator  a. 


Examples 

1.  We  have  shown  that  G = ^ ^90° '^180° '^270° '^360° ^ the  rota- 
tions of  the  square  leaving  the  vertices  fixed  is  a group.  This 
is  a cyclic  group  with  generator  Rgg°,  because  any  other  rotation 
may  be  obtained  by  repeated  application  of  Rgg0- 

2.  Consider  the  set  of  even  integers,  i.e.,  G = {•••,-4, -2, 0,2, 4,*..} 
with  the  operation  of  addition.  It  may  easily  be  shown  that  G is 

a group.  The  set  of  even  integers  is  a generator  group.  S = {2,-2}, 
where  we  mean  that  any  element  in  G is  a multiple  of  2 or  -2. 

Definition  39.  If  G is  a group,  and  a€G,  then  (a)  = {a*|i  = 
0,±1,****}  and  (a)  is  called  a cyclic  subgroup  of  G.  (If  there  exists 
an  element,  a,  such  that  G = (a),  then  G is  a cyclic  group.) 


Definition  40.  If  G is  a group  and  a^G,  then  the  smallest  posi- 
tive integer  K,  such  that  aK  = e is  called  the  period  of  a. 
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1.  In  the  case  where  G = {R900 , Rl80° > R270° » R360° ) « K = 4,  because 
(R9O0)4  = R90°*R90o*R90o*R90°  = r360°  = e. 

HOMOMORPH I SMS  AND  ISOMORPHISMS 

In  this  section  we  will  relate  two  groups  by  means  of  mappings  be- 
tween them.  These  mappings  will  indicate  the  similarities  of  structure 
of  the  two  groups. 

Definition  41.  A homomor phi sm  <{>  is  a mapping  from  one  group 
into  another  group  G2,  such  that  for  all  a,b  in  Gi,  <Ha*b)  = <Ma)o<Mb), 
where  * is  the  operation  for  G^  and  o is  the  operation  for  G2-  If  G^ 
and  G2  are  the  same  group  then  the  operations  * and  o are  the  same. 


Examples 

1.  Suppose  is  a mapping  from  G into  G,  defined  by  (x)  = 2x,  and  as- 
sume addition  is  the  operation  involved,  then  <}>  is  a homomorphism. 
This  is  true  because,  for  x and  y in  G,  4>  (x+y)  = 2(x+y)  = 2x  + 2y  = 

4>  (x)  + $ (y) . 

2.  Suppose  4>  is  a mapping  from  Gj^  into  G2,  and  that  Gj  is  the  real  num- 
bers together  with  the  operation  addition  and  G2  is  the  real  numbers 
together  with  the  operation  of  multiplication.  Define  by  4>  (x)  = 
2X.  Then,  <Mx+y)  = 2x+y  = 2x-2y  = $(x)'$(y).  Therefore,  $ is  a 
homomorphism. 

3.  Suppose  if  is  a mapping  from  G into  G^  and  G equals  the  integers, 
and  the  operation  under  consideration  is  addition.  Define  (Mx)  = 

x+1,  then  is  not  a homomorphism,  because 

♦(x+y)  = x + y + 1,  but 
$ (x)  + 4>(y)  = x + l+  y + l = x + y + 2. 


Definition  42.  A mapping  $ from  Gj^  into  G2,  with  G1  and  G2  being 
groups,  is  an  isomorphism  if 


(i)  <J>  is  a homomorphism,  i.e.,  ij>(a*b)  = (a ) o<#>  (b ) , where  * and 
o are  the  operations  of  G^  and  G^  respectively;  and 

(ii)  < p is  1 - 1.  That  is,  an  isomorphism  is  a 1 - 1 homomorphism. 
An  automorphism  is  an  isomorphism  of  G onto  itself. 
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Definition  43.  Two  groups  G^  and  G->  are  isomorphic  if  there  exists 
an  isomorphism  of  onto  G2 , i.e.,  there  exists  a mapping  that  is  a 
1-1  and  onto  mapping  such  that  4> (a*b)  = $ (a) of (b) , where  * and  o are 
the  respective  operations  for  G^  and  G2. 

It  is  important  to  realize  what  it  means  to  say  that  two  groups 
are  isomorphic.  It  does  not  mean  that  the  two  groups  are  equal  or  iden- 
tical. They  may  be,  but  they  don't  have  to  be.  It  does,  however,  in- 
dicate that  the  two  groups  are  structurally  alike  or  parallel.  To  es- 
tablish an  isomorphic  relationship  between  a man  and  a computer  does 
not  say  that  the  computer  is  the  same  as  the  man,  but  that  there  is  a 
1-1  correspondence  between  actions  of  the  man  and  simulated  actions 
of  the  machine. 

In  a poker  game  you  are  given  a chip  for  every  dollar  you  have; 
therefore,  there  is  a 1 - 1 correspondence  between  the  amount  of  chips 
you  have  and  the  amount  of  money  you  have,  but  a chip  is  not  the  same 
as  a dollar.  Try  getting  one  chip's  worth  of  gas  at  your  local  service 
station.  The  key  idea  of  speaking  of  isomorphic  sets  or  groups  is  to 
say  that  a structural  parallelism  exists  between  them. 


Example 

1.  If  we  let  G^  = {R90'  <r180°  ,r270°  ,R360o  ^ the  rotations  of  a 
square,  and  for  G2  consider  your  watch.  Set  it  at  12  o'clock. 
Define  four  elements:  changing  the  watch  to  3 o'clock,  6 o'clock, 

9 o'clock,  12  o'clock,  and  denote  these  changes  be  A^ , Ag,  Ag, 

A12  respectively.  We  may  find  a 1 - 1 onto  mapping  between  G^  and 

G2 : <t’(Rgo°)  = ^3»  'MR180°^  = ^6'  ^(R270°^  = ^9  > 4*  ^ = ^12" 

Also,  4>(x*y)  = 4>  (x)oif>  (y)  , e.g.,  4>  (R9o°*Ri80°  > = <MR270°)  = Ag  = 
A3oA6  = (Rgo°) (r190°^ ' Therefore,  G^  and  G2  are  isomorphic,  but 
certainly  a square  piece  of  paper  is  not  a watch,  yet  the  imposed 
structures  on  G^  and  G2  are  the  same. 


We  close  this  section  with  a few  descriptive  lemmas  concerning 
homomorphisms . 


Lemma.  If  4>  is  a homomorphism  for  G^  into  G2 , then  maps  the 
identity  element  of  G^  into  the  identity  element  of  G2,  i.e.,  41(e)  = e". 

Proof:  Let  x G,  then  4>(x)e  = 4*  (x ) , since  e is  the  identity  ele- 
ment of  G2.  But  41  (x)  = 4>(xe),  since  e is  the  identity  element  of  G^. 
Therefore,  4>(x)e  = 4>(xe),  but  4>  being  a homomorphism  implies  4(xe)  = 
4>(x)  4>(e).  We  thus  have  4>(x)e’  = 4>(x)4>(e),  from  which  we  deduce  that 
4>(e)  = e.  We  make  use  of  what  is  called  the  cancellation  law. 
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A valuable  term  related  to  a discussion  of  homomorphisms  is  that 
of  the  kernel  of  the  homomorphism. 


Definition  44.  The  kernel  of  a homomorphism  <f> , denoted  ker^  is 
defined  for  a homomorphism  (f>  from  Gj  into  G2,  to  be  the  set  of  elements 
in  G^  that  are  mapped  into  the  identity  element  of  G->.  ker«J>  » 
txCGj  |i|<{x)  » e). 


Recall  that  an  isomorphism  is  a 1 - i homomorphism.  An  alternative 
to  proving  that  <}>  is  1 - 1 is  the  next  lemma. 


Demina.  A homomorphism  from  G^  into  G2  is  an  isomorphism  if  and 
only  if  the  kernel  of  | consists  of  the  identity  element  of  G^  alone, 
i.e.  , ker<f>  - le). 


ADDITIONAL  IMPORTANT  GROUPS 

We  finish  up  this  chapter  with  a discussion  of  a few  very  important 
groups  that  deserve  special  mention.  In  chapter  3 we  examined  mappings. 
In  particular  we  investigated  1-1  mappings  of  a group,  or  actually  at 
that  time  we  just  spoke  of  a set,  onto  itself.  A result  wo  stated  with- 
out proof  was  that  the  composition  of  two  1-1  functions  was  a 1 - 1 
mapping  and  similarly,  the  composition  of  two  onto  mappings  was  an  onto 
mapping.  Therefore,  the  composition  of  two  1-1  onto  mappings  would 
lie  also  1-1  onto,  i.e.,  composition  of  mappings  is  a closed  operation. 
It  turns  out  that  the  composition  of  mappings  is  associative  as  well. 
There  exists  an  identity  mapping,  namely  f (x)  » x,  and  this  function 
we  could  denote  it  i would  be  the  identity  element  for  the  set  of  1 - 1 
onto  mappings.  Finally,  a 1 - 1 onto  mapping  has  an  Inverse  function 
that  is  also  a 1 - 1 onto  mapping.  Therefore,  the  set  of  all  1-1 
mappings  of  a set  onto  Itself  together  with  the  ofx' ration  of  composi- 
tion of  functions  is  a group.  It  is  not  an  abelian  group,  because  if 
we  return  to  the  discussion  of  Chapter  3,  it  is  clear  that  fog  and  gof 
generally  are  different. 

A closely  related  example  concerns  the  set  of  automorphisms.  An 
automorphism  was  defined  as  an  .isomorphism  of  a group  G onto  itself. 
Therefore,  an  automorphi sm  is  a l-l  mapping  of  G onto  G,  such  that 
^(a*b)  » ^(a)*<Hb),  where  * is  the  ofieration  for  G.  It  turns  out  that 
the  set  of  automorphisms  which  are  a subset  of  all  1-1  onto  mappings 
are  also  a group. 

The  last  example  is  tied  in  with  the  discussion  of  1 - 1 onto  map- 
pings. We  will  briefly  examine  permutation  groups. 
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Definition  45.  Let  S be  a set , then  a permutation,  denoted  by  n , 
is  a 1 - i mapping  of  S onto  itself. 

Therefore,  a permutation  is  a mapping.  The  distinction  between  a 
permutation  and  an  automorphism  is  that  S does  not  have  to  be  a group 
for  permu tat ions.  We  have  just  shown  that  the  set  of  all  1-1  mappings 
of  a set  onto  itself  is  a group,  i.e.,  the  set  of  all  permutations  of 
a set  forms  a group  with  the  operation  being  composition.  This  group 
is  referred  to  as  the  symmetric  group. 


Definition  4f>.  The  symmetric  group  is  the  group  formed  by  the 
set  of  all  1-1  mappings  of  a set  S mapped  onto  itself  under  the  opera- 
tion of  composition. 


Permutation  groups  are  most  valuable  when  the  set  under  considera- 
tion is  finite.  If  S = {ay , • • • ,an) , then  the  permutation  it  is  described 
by 

„ /31  a2  * * * an  \ 

11  l n (a  ) n (a  ) n (a  ) }' 

i.e.,  the  action  of  it  on  the  element  s in  S is  indicated  in  the  second 
row.  We  will  give  a detailed  analysis  of  the  symmetric  group  S on 
the  three  elements  ay,  a1f  a-j.  which  for  convenience  we  denote  1,2,3. 

For  example  if  « is  such ''that  1 goes  to  3 , 2 goes  to  2,  and  3 goes  to  1, 
then 


n 


(123 

'3  2 1 


)■ 


For  the  three  elements  1,2,3  there  are  six  possible  permutations, 
namely 


We  now  will  show  that_^3  = { n y « »2 » n3 » "4 ' ”5 » ”6 ^ a <?r°up.  The  opera- 
tion will  be  composition  and  will  be  performed  as  follows.  If  we  compute 
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(l  2 2 3>\ 

1'2OTI4  = V Jv  )'  we  start  the  1 in  the  left  permutation. 

'1  3 2'  '2  3 1' 

Below  the  1 is  another  1,  so  we  say  1 goes  to  1,  and  then  go  the  second 

permutation  in  the  1 spot.  Here,  1 goes  to  2.  So  we  have  1 •*  1 + 1 4 2, 

and  therefore,  1 -*■  2.  Next  we  start  with  the  2 in  the  left  permutation, 

2 -*■  3,  so  we  go  to  the  3 in  the  right  permutation,  and  see  that  3 goes 
to  1.  Therefore,  2+3+3+1,  or2  goes  to  1.  Finally,  we  start  at 

3 in  the  left  permutation.  3 -*  2 and  so  we  go  to  2 in  the  right  permu- 
tation and  2 -*  3.  Therefore,  3 •*  2 -*  2 + 3 or  3 ■*  3.  Combining  our 

results  we  have 


(1  2 3)(1  2 3) 


Another  example  would  be 


«5°"3 


- c 2 t 2 v c 2 3v  ■ • 

'312 ''213'  '321'  ^ 


where  1 ->■  3 -»  3 -+  3,  2 + 1 + 1 + 2,  and  3 


24241. 


A complete  table  would  look  like  the  one  in  Table  4.  Notice  that 

f1  2 ^ 

n = I J is  the  identity,  because  it  maps  each  element  into  itself. 

1 'l  2 3' 

From  the  table  it  may  now  be  verified  that/jj  3 is  a group.  We  have  al- 
ready proven  that  the  set  of  all  1-1  onto  mappings  of  a set  onto  it- 
self is  a group,  but  it  would  be  interesting  practice  for  the  reader  to 
try  to  verify  some  of  the  entries  in  Table  4. 


The  terms  transitive  and  regular  permutation  group  appear  fre- 
quently in  the  literature. 


Definition  47.  A permutation  group  is  said  to  be  transit ive  if  it 
has  the  property  of  containing  a permutation  which  replaces  any  given 
letter,  or  a^,  by  any  other  letter,  i.e.,  each  of  the  letters  of  the 
group  may  be  replaced  by  each  of  the  other  letters  of  the  group. 

Our  group an  example  of  a transitive  group. 


Definition  48.  A regular  permutation  group  is  a transitive  group 
whose  order,  or  number  of  mappings  in  the  group  is  equal  to  its  degree 
of  elements  or  letters  being  transformed. 
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Table  4 


*1 

*2 

"3 

71 4 

"5 

77  6 

*1 

"l 

*2 

"3 

"4 

*5 

"6 

"2 

"2 

ni 

*4 

"3 

71 6 

"5 

*3 

*3 

"5 

"l 

"6 

*2 

"4 

*4 

*4 

*6 

"2 

*5 

ni 

77  3 

"5 

"5 

"3 

*6 

"l 

77  4 

*2 

*6 

*6 

*4 

n5 

77  2 

*3 

*1 

We  now  have  completed  a fairly  rich  description  of  elementary  group 
theory.  The  examples  were  included  to  illustrate  the  new  definitions. 
The  precision  and  elegance  of  the  theory  hopefully  impresses  the  reader. 
If  there  would  be  any  way  that  psychology  could  draw  on  this  theory,  it 
would  be  most  desirable.  The  next  chapter  includes  an  impressive  list 
of  examples  of  how  group  theory  has  already  entered  the  domain  of 
psychology. 


CHAPTER  5 


THE  APPLICATION  OF  GROUPS  TO  PSYCHOLOGY 


There  will  not  be  any  new  mathematical  terminology  introduced  in 
this  chapter.  The  chapter  is  devoted  to  the  description  of  various 
applications  of  group  theory  in  the  behavioral  sciences. 

In  order  to  understand  Piaget's  theory  of  formal  operations  (Piaget  & 
Inhelder,  1958),  the  reader  should  be  familiar  with  basic  propositional 
logic,  which  is  an  area  outside  of  the  discussion  in  this  book,  and  the 
INRC  group,  which  is  now  within  the  realm  of  our  understanding.  There 
are  four  elements  in  this  group,  namely, 

(i)  I,  the  identity  operator,  which  when  applied  to  any  proposi- 
tion leaves  the  proposition  unaltered; 

(ii)  N,  the  negation  or  inverse  operator,  which  means  one  can 
return  to  the  starting  point  by  cancelling  an  operation 
already  performed; 

(iii)  R,  the  reciprocal  operator,  which  means  that  on<  uy  turn 
to  the  starting  point  by  compensating  a differe  i.e., 

the  product  of  two  reciprocal  transformations  is  tot  the 
identity  but  an  equivalence;  and 

(iv)  C,  the  correlative  operator  which  is  the  negation  of  the  re- 
ciprocal operator. 

The  multiplication  table  in  Table  5 is  the  same  as  that  of  the  "4- 
group"  discussed  in  the  preceding  chapter 


Table  5 

INRC 
I I N R C 

N N I C R 

R R C I N 

C C R N I 

To  fully  appreciate  the  role  of  the  INRC  transformation  would  re- 

quire a discussion  of  propositional  logic  and  Boolean  algebra,  but  we 
can  give  an  illustration  of  how  the  INRC  group  would  be  applied  in  the 
task  of  establishing  equilibrium  for  a balance. 
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Suppose  that  a balance  is  in  equilibrium,  we  may  cause  disequi- 
librium by  changing  one  of  the  weights  or  altering  the  distance  of  one 
of  the  weights  from  the  fulcrum,  or  performing  some  combination  of  a 
weight  and  distance  change.  Assume  we  replace  a weight  of  five  pounds 
with  a new  weight  of  ten  pounds.  Then  the  negation  or  inverse  of  this 
action  would  be  to  remove  the  ten-pound  weight  and  replace  it  again  with 
the  original  five-pound  weight.  An  example  of  a reciprocal  operation 
would  be  to  replace  the  weight  on  the  other  arm  of  the  balance  with  a 
weight  of  twice  the  original.  This  action  compensates  for  the  original 
action,  but  does  return  the  balance  to  equilibrium  in  the  exact  same 
way  as  it  originally  was.  The  correlate  would  be  the  negation  of  the 
reciprocal  transformation. 

The  most  important  changes  for  Piaget  are  the  negation  and  recipro- 
cal transformations.  They  are  the  two  forms  of  reversibility,  i.e.,  the 
original  situation  may  be  restored  by  either  cancelling  a performed  opera- 
tion or  by  compensating  for  the  operation.  An  understanding  of  the  role 
of  reversibility  in  Piagetian  theory  cannot  be  whole  without  an  appreci- 
ation of  the  underlying  mathematical  framework  of  his  theory. 

There  are  certain  weaknesses  and  limitations  in  the  Piagetian 
logical-mathematical  model  for  the  stage  of  formal  operations.  Bart 
(1971)  points  out  that  the  INRC  transformation  group  is  inadequate  in 
explaining  how  certain  logical  propositions  that  are  operations  can  be 
transformed  into  other  element  operations.  Therefore,  Bart  has  formu- 
lated a generalization  of  this  model.  The  generalization  presupposes 
an  understanding  of  the  Boolean  algebraic  structure  of  combinatorial 
thinking  and  the  regular  Boolean  permutation  group  structure  of 
hypothetico-deductive  thinking.  The  method  of  designating  the  formal 
transformations  in  the  groups  descriptive  of  formal  thought  is  in  terms 
of  the  symmetric  difference  operation  that  we  have  already  examined  in 
detail. 

One  weakness  in  Piaget's  theory  is  that  it  does  not  distinguish  the 
level  of  cognitive  complexity  of  one  level  of  combinatorial  ability  from 
another  level.  Suppose  represents  one  individual's  level,  and  1^+1 
another  individual's  level,  then  the  second  person  would  be  at  a higher 
level.  A type  of  mapping  or  transformation  defined  on  will  be  a 
permutation,  and  will  be  called  the  symmetric  difference  transformation. 
These  transformations  form  a group,  in  fact  a regular  permutation  group. 
From  this  framework  a method  of  positive  intersection  generators  is  em- 
ployed to  indicate  the  primitive  formal  transformations  proper  to  a 
level  of  formal  thought. 

The  generalization  model  can  describe  any  situation  that  Piaget’s 
INRC  model  can,  and  in  addition  those  cases  where  the  Piagetian  approach 
is  inadequate.  Also  the  generalization  has  qualitatively  distinct  levels 
within  the  stage  of  formal  operations. 
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Group  theory  may  be  used  to  study  the  kinship  of  different  primi- 
tive societies.  Boyd  (1969)  has  written  an  art  cle  on  this  topic.  He 
offers  a justification  for  applying  groups  to  model  marriage  class  sys- 
tems. For  example,  if  one  group  G^  evolves  into  a second  group  G2 , 
then  G^  and  G2  are  related  through  homomorphic  images.  The  actual  kin- 
ship systems  are  generated  by  means  of  grammars  and  the  kinship  system 
may  be  clarified  by  componential  analysis  through  the  use  of  Cartesian 
products.  Boyd  points  out  that  if  the  dimensions  are  generation  and 
sex,  then  (+1,  female)  would  be  someone's  mother.  His  goal  is  to  use 
a mathematical  model  to  bring  seemingly  different  problems  into  a larger 
all-encompassing  theory.  The  theories  of  kinship  grammars  and  componen- 
tial analysis  are  related  by  a regular  permutation  group. 

Boyd  gives  a study  of  the  Arunta  tribe,  an  Australian  tribe  that 
has  marriage  classes.  The  Arunta  make  distinction  between  older  and 
younger  siblings,  and  the  sex  of  the  speaker  influences  which  kinship 
term  is  required.  The  set  of  one  word  kinship  terms  are:  a man's 
father;  a man's  mother;  a woman's  father;  a woman's  mother;  elder  brother; 
elder  sister;  younger  brother;  younger  sister;  a man's  child;  a mein's 
son;  a man's  daughter;  a woman's  son;  a woman's  daughter;  wife;  and  hus- 
band. Boyd  calls  this  setvf^.  Any  other  relatives  may  be  formed  by  com- 
posing some  of  the  above  terms. 

The  Arunta  tribe  may  be  peirtitioned  into  eight  marriage  classes. 

All  the  fathers  of  children  in  a particular  class,  themselves  came  from 
the  same  class,  and  conversely  all  the  children  of  men  in  a given  class 
belong  to  the  same  class.  This  relation  of  fatherhood,  F,  describes  a 
permutation,  and  similarly  the  relation  of  motherhood,  M,  describes  a 
permutation.  Other  relations  may  be  derived  from  M and  F.  The  set  of 
all  possible  compositions  of  the  permutations  F and  M generate  a permu- 
tation group.  In  fact,  the  group  is  a regular  permutation  group.  From 
this  group  the  other  kinship  terms  may  be  incorporated  into  this  network. 

For  Boyd,  the  meaningful  way  to  apply  groups  to  psychology  is  to 
study  the  permutation  or  transformation  groups  of  a structure  onto  it- 
self, because  it  is  the  study  of  actions  or  transformations  that  offer 
insight  into  problems. 

Group  theory  has  been  applied  to  questions  in  perception.  Hoff- 
man (1966)  demonstrated  that  perceptual  constancies  such  as  image  loca- 
tion in  the  field  of  view,  size  constancy,  shape  constancy,  and  others 
may  be  described  in  terms  of  Lie  groups  of  transformations.  Our  dis- 
cussion of  his  articulation  must  of  necessity  be  rather  superficial, 
since  a Lie  group  is  more  than  a group.  It  is  also  a differential  mani- 
fold, and  Lie  theory  is  on  a much  higher  plane  than  our  elementary  ex- 
amination of  groups.  The  interested  reader  would  have  to  consult  mathe- 
matical textbooks  on  Lie  theory.  Hoffman  offers  an  explanation  of  how 
a Lie  theory  of  visual  perception  may  be  used  to  account  for  complemen- 
tary after-images,  i.e.,  the  after-effect  of  seen  movement,  and  the 
visual  analog  of  relativistic  length  contraction. 


and  tS^v  HQAi?  aVC  *PPliCatlon  in  the  theory  of  measurement.  Luce 
^ l Pr°Vlded  a theory  for  interval  measurement  based  on 

distinct  °b:,eCtS'  *°  lon<^  as  the  contributions  of  at  least  two 

distinct  factors  are  simultaneously  considered.  This  theory  is  called 

conjoint  measurement.  Krantz  (1964)  considers  an  approach  In  which  an 

may  66  rined  in  a CarteSian  £*»«*  -h  a 

arLo  n ^ resulting  set  of  equivalence  classes  form  a commutative 
morphic  i l*™ t h grOUp. structures  in  the  same  product  set  will  be  iso- 
^ Cin  ; ^ r6  eX^StS/n  iS0m0rPhism  of  one  group  onto  the  other, 
partial  nr^  ordered  group,  which  is  defined  as  a group  with  a 

s ~ a"  - that  for  x'yCG  and  X<y'  then  for  a"v 

ina  'the  r "«* . ***  < z*y . Further,  if  < is  a linear  or  simple  order- 
a"9'  then  ■ G is  a simply  ordered  group.  An  Archimedean  simply  ordered 
group  is  defined  to  be  a group  where  for  x * e,  e the  identity  element, 
and  y any  element  in  G,  there  then  exists  an  integer  n such  that  xn>y. 

He  then  establishes  that  an  Archimedean  simply  ordered  group  is 

l'*9™'1*  °f  lh<!  ”«-»'•  under  addition,  Sch  in 
turn  then  leads  to  interval  scale  measurement. 

..  i-  Crofs~context  matching  is  the  situation  where  an  observer  states 

text  Ce^aitzSQ968l  ln°ne  C°nteXt  matCh  °ther  Stimuli  in  another  con" 
Inother^  a k 90  °Ut  that  tHe  chan9in<?  one  context  S to 

another  T,  describes  a function  he  denotes  by  gq  T,  where  gc  „(A)  = B 

"JL\tS  4 ^1"UlUS  in  * and  B is  a ” V^roeivlno 

3Mti^l  J '>0t,en0U',h  to  ask  about  particular  stimulus,  the 

r te™P°ral. context  must  also  be  considered,  if  there  exists 
a set  of  transformations  of  the  stimulus  elements  such  that  these  map- 
pings form  a semigroup,  i.e.,  a closed  associative  set,  and  if  the  col- 
lection of  mappings  are  context-invariant,  then  the  g_  _ are  transfor- 

Sy1beSuMlIz^UrtWe  gT°ups ' and  knowledge  of  certa!^contcxt  effects 

Trt icle  falir  • iPra  1Ctlu9  °ther  COnteXt  effects*  W>«t  makes  this 
levels  involved  is  that  the  discussion  is  going  on  at  three 


(i)  transformations  of  stimuli; 
(ii)  isomorphisms  of  transformation 


groups;  and 


(in)  functions  from  pairs  of  contexts  into  the  group  of  auto- 
morphisms of  a transformation  group.  This  third  level  is 
where  the  predictive  power  of  context  changes  is  richest. 

and  for  thl^10^  ^ c*‘ucial  to  be  able  to  replicate  a test  or  task, 
™ bhlS1fSaSOn  line's  (1970)  article  on  transformations  that 

er^IzatIona^e^CUrVmK  " "V  Sh°Uld  * °f  interest-  In  stimulus  gen- 
^ *tudies'  Thurstoman  psychophysics,  mental  test  theory,  JND 

out  the  a"d  Fecbnerian  Psychophysics  and  utility  theory,  Levine  points 
out  the  value  of  comparison  between  two  tests,  two  curves,  etc  He 
sees  the  finding  of  all  the  functions  that  render  a given  set  of 
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functions  parallel  to  be  a major  task.  These  functions  are  referred 
to  as  scales.  Any  scale  that  renders  a set  of  scales  parallel  is  called 
a solution  for  the  set,  and  a set  having  a solution  is  called  a uniform 
system.  As  an  illustration,  a set  of  two  scales  is  a uniform  system  if 
and  only  if  the  set  is  uncrossed,  i.e.,  if  F and  G are  the  scales, 

F(x)  < G (x)  for  all  x,  or  F(x)  =*  G(x)  for  all  x,  or  F(x)  > G(x)  for  all 
x.  This  is  then  generalized  to  any  'arbitrary  number  of  scales.  More 
precisely,  each  scale  may  be  thought  of  as  a 1 - 1 continuous  mapping 
of  the  real  numbers  onto  themselves.  The  operation  involved  is  composi- 
tion, and  each  set  of  scales  is  associated  with  a unique  group  under 
the  operation  of  composition. 

It  turns  out,  for  example,  that  if  two  sets  of  scales  have  the 
same  associated  group,  they  also  have  the  same  set  of  solutions  render- 
ing them  parallel.  By  an  associated  group,  Levine  means  that  for  each 
pair  of  scales  F and  G in  a set  of  scales,*^,  the  associated  group  of 
that  set  of  scales  is  the  group  generated  by  F“^G. 

By  following  Levine's  procedures,  the  psychologist  can  determine 
whether  his  sets  of  curves  may  be  rendered  parallel  or  if  he  must  modify 
his  approach. 

A relatively  new  area  in  psychology  where  mathematics  is  used  is 
the  study  of  language  and  communication.  Chomsky  (1963)  has  been  con- 
sidering the  question  of  how  is  it  that  a person  has  the  ability  to 
comprehend  sentences  that  he  has  never  heard,  and  on  other  occasions, 
provide  appropriate  novel  responses.  Chomsky  describes  the  flow  of 
speech  as  a sequence  of  discrete  atoms  that  are  concatenated,  i.e. , 
right  after  each  other. 

He  defines  a system,  with  L being  the  set  of  all  finite  sequences 
that  can  be  formed  from  the  elements  of  some  arbitrary  finite  set  V. 

He  defines  an  operation that  represents  the  result  of  concatenating 
two  sequences  | and  \ Q L.  If  4>— >x  “ <J»,  where  L,  i.e.  , is  a new 
finite  sequence,  then  L is  closed  under The  operation  — n is  also 
associative  ^ = ♦ — ^ (\- — ■^1')  * provided  that  one  carefully  formu- 

lates what  he  means  by  associativity.  The  empty  or  null  sequence  is 
the  identity  element,  so  L under  the  operations  may  be  viewed  as  a 
monoid  or  semigroup  with  an  identity  element. 

► 

Chomsky  gives  an  example  of  why  associativity  must  be  carefully 
defined.  Notice  that  "they ^(are ''-(flying^planes) ) " has  a different 
meaning  from  "they^(are'~'flying)^planes) . " This  difficulty  is 
avoided  by  assuming  that  a language  has  several  distinct  levels.  Lower 
levels  are  specified  by  how  they  relate  to  higher  levels.  It  is  neces- 
sary then  to  have  several  concatenation  systems.  These  systems  are  used 
in  the  attempt  to  characterize  a grammar  in  such  a way  that  an  explicit 
enumeration  of  grammatical  sentences  is  possible. 
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The  process  of  coding  is  the  mapping  of  one  monoid  into  another. 
Chomsky  illustrates  this  by  considering  one  monoid  to  be  all  the  strings 
that  can  be  formed  from  the  characters  of  a finite  alphabet  A,  and  the 
other  monoid  to  be  all  the  strings  that  can  be  formed  by  words  in  a 
finite  vocabulary.  A code  would  be  an  isomorphism  of  U into  a subset 
of  A.  The  theory  is  then  extended  to  states,  where  a state  of  a coding 
system  represents  the  memory  at  a given  moment.  The  memory  is  augmented 
with  time. 

Arbib  (1968)  has  edited  a book  on  the  algebraic  theory  of  machines 
and  languages  in  which  the  discussion  is  in  terms  of  semigroups.  In 
one  particular  chapter,  Assmus  and  Florentin  (ibid.)  explain  machine 
theory  using  semigroups  as  the  fundamental  connection  between  algebra 
and  machines.  The  semigroup  is  used  to  form  a standard  version  of  any 
machine,  methods  of  decomposing  semigroups  describe  parallel  decomposi- 
tions of  the  machine  into  components,  and  also  the  definitions  of  irre- 
ducible component  machines  are  in  terms  of  the  decompositions  of  semi- 
groups, and  then  these  irreducible  component  machines  are  used  to  build 
all  other  machines.  If  the  state  transition  maps  are  permutations, 
then  a machine  with  only  permutations  as  mappings  has  a semigroup  that 
is  actually  a group.  The  set  of  permutations  are  transitive,  i.e.,  any 
state  can  be  reached  from  any  other  state. 

An  examination  of  the  book  clearly  reveals  that  the  parallel  study 
of  machines  and  the  theory  of  semigroups  is  necessary  to  have  any  real 
appreciation  of  the  foundations  of  machine  or  automata  theory. 

Berlyne  (1964)  has  a chapter  on  group  structures  and  equilibrium 
in  his  book.  He  begins  by  talking  about  habit  family  structures,  i.e., 
there  exist  parallel  strands  joined  together  at  their  beginnings  and 
ends,  which  indicate  that  each  has  the  same  stimuli  situation,  and  each 
led  to  the  same  response.  He  then  describes  how  the  habit  family  hier- 
archies in  thinking  must  be  more  complex,  and  suggests  that  the  study 
of  transformation  groups  may  be  helpful.  He  draws  on  the  work  of  people 
like  Piaget  and  Poincar£. 

For  example,  a group  has  an  inverse,  which  may  either  be  a compen- 
sation or  a cancellation.  The  importance  of  reversibility  in  thinking 
and  questions  of  equilibrium  is  of  the  utmost.  The  ability  to  consider 
an  action,  and  then  determine  whether  it  is  appropriate  or  not,  without 
actually  carrying  it  out,  is  fundamental  to  thinking.  Any  behavior  sys- 
tem possessing  a group  structure  also  would  have  a habit  family  hierarchy, 
but  Berlyne  points  out  that  the  converse  is  not  true.  The  system  may 
for  instance  have  a groupoid,  semigroup,  or  monoid  structure. 

In  situations  where  group  structures  are  relevant,  a transitive 
transformation  group  is  the  most  desirable,  because  it  always  allows 
the  possibility  to  get  from  any  one  element  to  any  other  element  by 
means  of  one  transformation.  This  offers  great  efficiency  and  economy 
of  effort  in  assessing  any  situation.  For  this  reason,  the  considera- 
tion of  transitive  groups  should  be  applied  to  questions  of  equilibrium. 
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In  a transitive  group  structure,  no  starting  point  is  needed,  because 
no  matter  what  situation  a person  encounters,  the  person  has  the  abil- 
ity to  compensate  or  modify  it. 

Natapoff  (1970)  illustrates  how  groups  may  be  used  in  synmetric 
choice  experiments.  He  defines  a symmetric  choice  experiment  as  an 
experiment  where  the  way  the  distribution  of  choices  among  alternatives 
that  appear  almost  identical  depends  on  those  minor  differences  among 
the  alternatives.  The  seeming  equivalence  reflects  the  symmetry  of  the 
problem,  while  the  differences  indicate  the  restrictions  or  limitations 
of  the  symmetry.  Group  theory  is  helpful  in  analyzing  such  experiments. 

If  S2 » • • • , Sjj  are  N similar  alternatives,  he  calls  them  states,  of 
some  fixed  quantity  that  is  to  be  symmetrically  distributed,  then  f(Si> 
will  represent  the  fractional  share  of  the  quantity  that  is  given  to 
the  ifch  choice.  If  two  states  are  the  extent  of  the  choices,  then 
f(Si>  + f (S2)  = 1,  where  1 represents  the  entire  quantity  under  consid- 
eration. In  general  f(Si)  + •••  + f(Sfl)  = 1. 

Suppose  that  all  of  the  states  are  essentially  the  same;  the  choose 
one  as  a reference  state  and  form  a set  G,  G = {gi,***,gij},  where  the 
g^  are  transformations  mapping  the  reference  state  into  each  of  the 
original  N states.  Therefore,  one  of  the  g^  will  be  the  identity 
transformation. 

The  focus  of  the  task  is  no  longer  on  N states,  but  one  reference 
state  and  a set  of  transformations.  G reflects  the  symmetry  of  the  set 
of  states,  and  the  set  of  transformations  g form  a group.  Actually, 
which  state  is  used  as  the  reference  state  is  immaterial.  The  set  G 
will  always  produce  the  N states  Si,...,Sjj,  only  the  order  for  giSj , 
g2Sj,...gNSj  may  be  different.  For  example,  g2S^  may  be  S5  and  g2sj 
may  be  S7. 

From  here  Natapoff  shows  that  every  symmetric  choice  function  may 
be  reduced  to  a simpler  type  of  function,  from  which  greater  amounts  of 
information  may  be  extracted  than  if  the  built-in  symmetry  of  the  ex- 
periment was  not  taken  advantage  of. 

Hopefully,  the  11  examples  of  the  application  of  groups  to  psy- 
chology have  illustrated  the  broad  range  of  uses  of  groups  already  in 
the  psychological  literature.  Yet  the  value  of  mathematical  analysis 
has  not  been  fully  appreciated.  If  this  chapter  has  served  as  a moti- 
vation to  begin  a closer  examination  of  the  potential  power  of  mathe- 
matical structures,  then  this  book  has  fulfilled  its  purpose. 
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CHAPTER  6 


RINGS  AND  FIELDS 


This  chapter  will  be  relatively  short,  because  presently  there 
are  very  few  applications  of  rings  and  fields  to  psychology.  This 
does  not  mean  that  rings  and  fields  will  not  be  helpful  in  analyzing 
psychological  questions,  but  rather  that  their  applicability  has  not 
really  been  tested  yet.  In  this  chapter  we  will  define  the  important 
terminology  and  illustrate  these  definitions  through  fairly  elementary 
mathematical  examples.  A few  basic  properties  of  rings  and  fields 
will  be  proven  to  give  the  reader  a greater  feeling  of  how  these  new 
concepts  may  be  used. 

All  the  algebraic  structures  that  will  be  introduced  have  the 
common  quality  of  having  two  operations.  Remember,  the  group  concept 
has  only  one  operation.  The  ring  is  the  most  fundamental  of  the  two- 
operation  structures. 


Definition  49.  A ring  R is  a nonempty  set  of  elements  with  two 
operations  defined  on  it;  for  convenience  they  are  denoted  by  + and  *, 
such  that 


(i) 

For 

all  a,b£R,  a 

+ b€R; 

(ii) 

For 

all  a ,b,c€  R, 

a + (b  + c)  = (a  + b)  + c; 

(iii) 

There  exists  an  element  0 in  R,  such  that  a 
for  all  a£R; 

+ 0 

= 0 + a = a 

(iv) 

For 

a + 

every  a in  R 
(-a)  = (-a)  + 

there  exists  an  element  -a 
a = 0; 

in  R 

, such  that 

(v) 

For 

every  a,b£R, 

a + b = b + a; 

(vi) 

For 

every  a,b€  R, 

a-b£  R; 

(vii) 

For 

all  a,b,c£R, 

a- (b-c)  = (a*b) *c ; 

(viii) 

For 

b*a 

all  a,b,c  € R, 
+ c*a.  This 

a* (b  + c)  =a-b+a*c  and  (b  + 
law  is  called  the  distributive 

c)  -a  = 
law. 

In  reading  through  these  eight  conditions  that  must  be  satisfied 
for  a set  to  be  a ring,  perhaps  the  reader  observed  that  this  definition 
may  be  written  more  compactly. 
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Definition  50.  A ring  R is  a nonempty  set  of  elements  with  two 
operations,  denoted  by  + and  -,  such  that 

(i)  R is  an  abelian  group  under  +; 

(ii)  R is  a semigroup  under  •;  and 

(iii)  R satisfies  the  distributive  property,  i.e.  , for  all  a,b,c£R, 
a* (b  + c)  = a-b  + a-c  and  (b  + c) -a  = b-a  + c*a. 


The  other  algebraic  structures  that  we  will  consider  are  built  up 
from  a ring  by  adding  additional  properties. 


Definition  51.  A ring  with  an  identity  R is  a ring  where  the  opera- 
tion • has  an  identity  element,  i.e.,  there  exists  an  element  1£R  such 
that  for  every  aCR,  a-1  = 1-a  = a.  Therefore,  R is  a monoid  under  the 
operation  • . 


Definition  52.  A commutative  ring  R is  a ring  for  which  the  opera- 
tion • is  commutative,  i.e.,  for  every  a,b£R,  a-b  = b-a. 


Definition  53.  A ring  is  called  an  integral  domain  if  it  is  a 
commutative  ring  with  an  identity  and  satisfies  the  additional  property, 
that  if  for  a,b€TR  we  have  a-b  = 0,  then  either  a = 0 or  b = 0 or  both 
a and  b equal  0. 


This  added  property  has  a name. 


Definition  54.  In  a commutative  ring,  if  for  a / 0 there  exists 
an  element  b / 0,  such  that  a-b  = 0,  then  a is  called  a zero  divisor. 


Definition  55.  A division  ring  R is  a ring  where  its  nonzero  ele- 
ments form  a group  under  the  operation  • . 


The  final  related  definition  is  that  of  a field. 


Definition  56.  A field  F is  a ring  whose  nonzero  elements  form  a 
commutative  group  under  the  operation  -,  or  in  other  words,  a field  is 
a commutative  division  ring. 
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Figure  34  in  a sense  indicates  an  ordering  among  the  related  con- 
cepts and  may  aid  in  learning  the  new  definitions.  A similar  diagram 
appears  in  Dean  (1966) . In  his  figure  a line  from  one  definition  A to 
a definition  B,  higher  on  the  figure,  indicates  that  every  system  in  A 
is  also  a system  in  B. 


Figure  34 

Before  we  begin  to  look  at  seme  examples,  it  should  be  pointed  out 
that  the  operations  + and  • do  not  have  to  be  normal  arithmetic  addition 
and  multiplication.  They  may  represent  any  pair  of  operations  satisfy- 
ing the  list  of  conditions. 


Examples 

1.  Consider  the  integers  with  the  operations  of  arithmetic  addition 
and  multiplication.  We  have  already  proven  that  the  integers  form 
a group  under  addition,  in  fact  in  abelian  group.  The  integers  are 
closed  under  multiplication  and  are  also  associative  and  commutative 
under  multiplication  and  the  distributive  property  holds.  There  is 
an  identity  element,  namely  1,  since  any  integer  times  1 is  the  same 
integer.  However,  the  integers  with  the  exception  of  1 and  -1  do 
not  have  their  multiplicative  inverses  in  the  integers.  For  example, 
the  inverse  of  5 is  1/5.  Therefore,  the  integers  with  + and  • form 

a commutative  ring  with  identity  element.  If  we  now  observe  that 
there  are  no  zero  divisors  in  the  integers,  i.e. , the  only  way  the 
product  of  two  integers  can  be  zero  is  if  at  least  one  of  them  is 
zero,  then  we  may  conclude  that  the  integers  are  an  integral  domain. 

2.  The  even  integers  with  the  operations  of  addition  and  multiplication 
would  be  a commutative  ring.  The  even  integers  are  equal  to  {•••*, 

-4 ,-2,0,2 ,4, • • • • ) , and  therefore,  there  is  no  multiplicative  identity. 


t> 
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3.  An  example  of  a field  would  be  the  rational  numbers  with  the  opera- 
tions of  addition  and  multiplication.  The  multiplicative  identity 
is  1,  and  the  rationals  have  the  multiplicative  inverse  of  any  ele- 
ment. For  example,  the  inverse  of  9 would  be  1/9,  of  2/3  would  be 
3/2,  etc.  Therefore,  the  rationals  form  a commutative  group  under 
addition,  a commutative  group  under  multiplication,  and  clearly  the 
distributive  property  holds. 

4.  If  the  set  under  consideration  is  the  set  of  functions  from  the 
real  numbers  into  the  real  numbers,  and  the  operations  are  defined 
by 

(f  + g)  (x)  - f (x)  + g (x) 

(f  *g)  (x)  - f (x)  • g (x)  , 

then 

(i)  Closure  under  + follows  from  the  definition. 

(ii)  ((f  + g)  + h)  (x)  <«  (f  + g)  (x)  + h(x)  « f (x)  + g(x)  + h(x)  " 
f (x)  + (g  + h) (x)  « (f  + (g  + h))(x).  Therefore,  + is  as- 
sociative. 

(iii)  The  identity  element  for  + is  the  function  that  is  identi- 
cally 0,  i.e.,  (f  + 0)  (x)  - f (x)  + 0(x)  » f (x)  . 

(iv)  The  inverse  of  a function  f will  be  -f  under  addition,  since 
(f  + (-f ) ) (x)  - f (x)  - f (x)  - 0. 

(v)  The  set  of  functions  is  abelian,  since  (f  + g)  (x)  *=  f (x)  + 
g (x)  - g (x)  + f ( x ) - (g  + f ) (x) . 

(vi)  Closure  under  • follows  from  the  definition. 

(vii)  Similarly,  the  associativity  of  • follows. 

(viii)  The  distributive  laws  hold.  We  prove  one  of  them,  and  the 
other  follows  in  the  same  manner. 

(f  • (g+h) ) (x)  - f (x)  • (g+h)  (x)  •»  f(x)-|g(x)  + h(x)]  - 
f(x)*g(x)  + f (x) • h (x)  - (f-g  + f*h)(x). 

Therefore,  the  set  of  functions  from  the  real  numbers  into 
the  real  numbers  is  a ring. 

There  is  an  identity  element,  namely  the  function  identical  to 
1,  hi nee  (f • 1) (x)  ■ f(x)*l(x)  - f (x) . The  commutivity  of  • follows 
i iron i at e 1 y f rom  the  definition.  The  set  of  function  is  not  an  in- 
• ii  il  1.  main,  because  there  exists  a function  not  equal  to  zero, 

«i>.  ■ i raluct  is  the  zero  function.  For  example,  if  f is  defined  as 
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Figure  34  in  a sense  indicates  an  ordering  among  the  related  con- 
cepts and  may  aid  in  learning  the  new  definitions.  A similar  diagram 
appears  in  Dean  (1966) . In  his  figure  a line  from  one  definition  A to 
a definition  B,  higher  on  the  figure,  indicates  that  every  system  in  A 
is  also  a system  in  B. 


Rings  with 
Identity 


Division 

Rings 


Commutative 
Rings 

Integral  Domains 


Fields 


Figure  34 


Before  we  begin  to  look  at  some  exan4>les,  it  should  be  pointed  out 
that  the  operations  + and  • do  not  have  to  be  normal  arithmetic  addition 
and  multiplication.  They  may  represent  any  pair  of  operations  satisfy- 
ing the  list  of  conditions. 


Examples 

1.  Consider  the  integers  with  the  operations  of  arithmetic  addition 
and  multiplication.  We  have  already  proven  that  the  integers  form 
a group  under  addition,  in  fact  in  abelian  group.  The  integers  are 
closed  under  multiplication  and  are  also  associative  and  commutative 
under  multiplication  and  the  distributive  property  holds.  There  is 
6m  identity  element,  neimely  1,  since  any  integer  times  1 is  the  same 
integer.  However,  the  integers  with  the  exception  of  1 and  -1  do 
not  have  their  multiplicative  inverses  in  the  integers.  For  example, 
the  inverse  of  5 is  1/5.  Therefore,  the  integers  with  + and  • form 

a commutative  ring  with  identity  element.  If  we  now  observe  that 
there  are  no  zero  divisors  in  the  integers,  i.e.,  the  only  way  the 
product  of  two  integers  can  be  zero  is  if  at  least  one  of  them  is 
zero,  then  we  may  conclude  that  the  integers  are  an  integral  domain. 

2.  The  even  integers  with  the  operations  of  addition  and  multiplication 
would  be  a commutative  ring.  The  even  integers  are  equal  to  {•••*, 
-4, -2, 0,2, 4, ••••},  and  therefore,  there  is  no  multiplicative  identity 
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■ - ■-»- 


if  x > 0 . . . ..  . . . . SO  if  x 2 0 

if  x < 0 and  g i3  defined  by  g(x)  " (l  if  x < 0 ' thpn 
the  product  function  (f*g) (x)  « f(x)g(x)  « 0 for  all  x. 

5.  In  the  chapter  on  relations  we  showed  that  the  relation,  the  re- 
mainder upon  division  by  5,  partitioned  the  integers  up  into  five 
classes,  namely,  [0]  » {••••,-10,-5,0,5,10,....},  [1]  » {••••,-9, 

-4,1,6,11,....},  [2]  - {••••, -8, -3,2, 7, 12, ••••},  [3]  = -7, 

-2,3,8,13,...*},  and  [4]  — {■••• ,-6,— 1,4,9,14 ,••••} . Let  R = 

{ [0] , [1) , [2] , [3] , [4]  }>  we  will  show  that  if  [m]  + [n]  is  defined 
to  be  the  remainder  of  m + n upon  division  by  5,  and  [m]*[n]  is 
defined  to  be  the  remainder  of  m*n  upon  division  by  5,  then  R is 
a commutative  ring  with  a unit  element.  In  fact,  we  will  be  able 
to  show  that  R is  a field.  That  R is  a ring  is  easily  verifiable 
from  the  definitions  of  the  operations.  For  example,  [0]  would 
serve  as  the  identity  element  in  addition.  The  additive  inverses 
of  [0]  would  be  [0J,  of  [1]  would  be  [4],  of  [2]  would  be  [3],  of 
[3]  would  be  [2],  and  of  [4]  would  be  [1],  since  in  each  case  the 
sum  is  equal  to  (0].  The  distributive  property  may  be  verified 
rather  easily.  One  illustration  of  the  distributive  law  is 
[2]-([3]  + [4])  = [2]- [7]  = [2l-[2l  = [4],  and  [2]-[3]  + [2] - [4)  = 
[6]  + [8]  »■  [1]  + [3]  = [4].  Therefore,  [2]-([3]  + [4])  «* 

[ 2 ] • [ 3 ] + [2]* [4].  If  we  now  assume  that  R is  a ring,  we  observe 
that  [1]  serves  as  the  multiplicative  identity.  The  commutativity 
of  • is  an  immediate  consequence  of  the  commutativity  of  the  in- 
tegers since  for  two  integers  n and  m,  n*m  = m-n.  Each  element 
has  a multiplicative  inverse;  the  inverse  of  [1]  is  [1],  of  (2] 
is  [3],  of  [3]  is  [2],  and  of  [4]  is  [4],  because  in  each  case  the 
product  equals  [1].  Therefore,  R is  a field.  As  a means  of  re- 
viewing the  example,  we  include  product  tables  for  the  two  opera- 
tions in  Tables  6 and  7. 


Table  6 


+ 

[0] 

[1] 

[2] 

[3] 

(41 

To! 

10] 

m 

[2] 

[31 

[41 

m 

HI 

[2] 

[31 

[41 

[01 

[2] 

[2] 

[3] 

[41 

[0] 

HI 

[3] 

[3] 

[4] 

[0] 

[11 

[2  J 

(4) 

[4] 

[0] 

[11 

[21 

[31 

81 


Table  7 


[•] 

HI 

[2] 

[3] 

[4] 

[1] 

[1] 

[2] 

[3] 

[4] 

[2] 

[2] 

[4] 

[1] 

[3] 

[31 

[3] 

[1] 

[4] 

[2] 

[4] 

[4] 

[3] 

[2] 

[1] 

6.  An  interesting  observation  is  that  if  we  defined  the  relation  to 
be  the  remainder  upon  division  by  4,  then  there  would  have  been 
four  classes  [0],  [l],  [2],  [3].  However,  in  this  example,  the 
nonzero  elements  do  not  form  a group  under  multiplication.  There 
is  a zero  divisor,  namely  [2],  because  [ 2 ] - [ 2 ] = [0]  and  [2]  cer- 
tainly is  not  the  zero  element.  The  multiplication  table  in 
Table  8 shows  that  [2]  does  not  have  an  inverse  for  the  operation 
of  multiplication.  What  are  the  differences  between  division  by  4 
and  by  5 that  cause  such  a drastic  difference  in  the  structures  of 
the  two  systems?  As  an  exercise,  the  reader  should  do  a similar 
analysis  for  division  by  6 and  7 and  then  on  the  basis  of  these 
results  try  to  generalize  when  a system  will  be  a field  and  when 
it  will  not. 


Table  8 


['] 

[1] 

[2] 

[3] 

[1] 

[1] 

[2] 

[3] 

[2] 

[2] 

[0] 

[2] 

[3] 

[3] 

[2] 

[1] 

7.  If  we  consider  our  set  to  consist  of  all  the  subsets  of  some  given 
set,  and  let  the  two  operations  be  the  symmetric  difference  and 
intersection,  then  we  have  a commutative  ring  with  identity  (Bur- 
ton, 1965).  We  have  already  proven  in  the  chapter  on  groups  that 
for  the  set  of  all  subsets  of  some  universal  set,  the  symmetric 
difference  yields  a group  structure.  The  intersection  operation 
is  closed  and  associative.  Therefore,  if  the  distributive  law 
holds,  then  we  have  a ring.  Ar\  (BAC)  = AO((B  - C)U  (C  - B)  ] = 

[ A O (B  - C)]U  [AO(C  - B)].  By  an  argument  analogous  to  those  of 
the  first  chapter,  AO(B  - C)  = (AOB)  - (AOC)  and  AO  (C  - B)  = 
(AOC)  _ (AOB).  Therefore,  AO  (BAC)  = [AO  (B  - C)J  U [A  0 (C  - B)  ] = 
[(AOB)  - AOC]  U[AOC  - (AOB)]  = (AOB)  A (AOC).  Similarly, 
that  (BAC)OA  = (BOA)  A (CQA)  may  be  demonstrated.  Therefore, 
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our  system  is  a ring.  The  ring  is  commutative  because  aOb  = 

B^A,  and  the  ring  also  has  an  identity,  namely  the  universal  set, 
since  AOU  = A,  where  U is  the  universal  set. 


An  interesting  problem  that  may  be  proven  by  an  application  of  the 
distributive  law  is  that  any  number  times  zero  is  zero.  If  someone 
asked  you  why  a-0  = 0,  you  would  probably  say  because  anything  times 
zero  equals  zero,  and  he  would  again  say  why,  and  suddenly  you  are  in 
the  midst  of  a vicious  circle.  Let  us  actually  prove  that  a*0  = 0. 

Lemma.  Let  R be  a ring,  then  for  any  a£R,  a»0  = 0. 

Proofs  Let  a be  any  element  in  R.  If  o is  the  identity  element 
under  addition,  then  in  particular  0=0+0.  Therefore,  a*0  = a (0  + 0) 
a.O  + a*0.  But,  since  R is  a group  under  addition,  each  element  has  an 
inverse,  and  we  may  cancel  out  an  a-0  from  each  side  of  the  equation. 
Therefore,  0 = a-0,  or  equivalently  a-0  = 0. 


A rather  important  result  that  we  hinted  at  in  our  discussion  of 
the  various  rings  or  fields  formed  on  the  basis  of  the  relation  defined 
by  the  remainder  upon  division  by  a particular  number  will  be  stated 
without  proof. 


Theorem.  A finite  integral  domain,  i.e. , an  integral  domain  with  a 
finite  number  of  elements,  is  a field. 

In  the  example  based  on  division  by  5,  we  had  a field  structure, 
however,  with  division  by  4;  there  were  zero  divisors;  hence  we  did 
not  have  an  integral  domain,  and  consequently  we  did  not  have  a field. 
Notice  that  this  theorem  only  holds  for  finite  sets. 

A third  interesting  question  is  would  it  be  possible  in  a ring  to 
have  the  identity  element  under  addition  and  under  multiplication  be 
the  same  element?  The  answer  is  no;  they  are  distinct  provided  that 
the  ring  is  not  the  ring  consisting  of  0 alone. 


Theorem.  Let  R be  a ring  with  an  identity,  and  assume  R / {0}, 
then  the  elements  0 and  1 are  distinct. 

Proof;  Let  a be  a nonzero  element  of  R.  If  1 is  the  identity  ele- 
ment, then  a-1  = a.  We  also  have  just  proven  that  for  a£  R,  a>0  = 0. 
Therefore,  0 is  not  possibly  equal  to  1,  unless  a = 0,  but  by  assump- 
tion a ^ 0. 
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In  the  discussion  of  groups  we  spoke  of  subgroups,  and  it  is 
reasonable  that  in  our  examination  of  rings  we  would  like  to  have 
the  corresponding  idea  of  a subring. 

Definition  57.  Let  R be  a ring  and  suppose  that  S is  a subset  of 
R,  such  that  under  the  same  operation,  + and  •,  that  are  used  in  R, 
that  S is  itself  a ring,  then  S is  called  a subring. 


It  is  not  necessary  to  check  all  the  properties  of  a ring,  because 
several  of  them  are  built  into  the  ring  structure.  For  example,  if  R 
is  associative,  clearly  a subset  of  R,  namely  S,  is  associative.  It 
turns  out  the  crucial  properties  to  check  are  essentially  three  in 
number . 


Theorem.  A nonempty  subset  S of  a ring  R is  a subring  if  and  only 
if 

(i)  For  all  a,b£s,  a + b€S,  where  + is  the  additive  operation 
of  R; 

(ii)  For  every  aCS,  -a  is  also  an  element  of  S,  i.e.,  the  addi- 
tive inverse  is  in  S for  every  element  of  S;  and 

(iii)  For  all  a.bCS,  a-b£S,  where  • is  the  multiplicative  operation 

It  is  not  necessary  to  have  a separate  condition  that  0 belong  to 
S because  if  aCS,  then  by  (ii)  -a  also  belongs  to  S.  Now  applying  (i)  , 
since  a and  -a  both  belong  to  S,  then  a + (-a)  = 0 also  is  in  S. 


Examples 

1.  The  even  integers  are  a subring  of  the  integers  under  normal  addi- 
tion and  multiplication.  If  we  apply  the  previous  theorem,  we  see 
that  the  set  of  even  integers  is  closed  under  addition,  has  an 
additive  inverse  for  every  element,  and  is  closed  under  multiplication 

2.  The  odd  integers  would  not  be  a subring  because  they  are  not  closed 
under  addition.  For  example,  3 and  5 are  both  odd  integers,  but 

3 + 5 ■ 8,  and  8 is  not  an  odd  integer. 

3.  Another  example  of  a subring  is  the  ring  (or  actually  the  field) 
of  rational  numbers  which  has  the  integers  as  a subring. 
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We  introduced  the  concept  of  a homomorphism  in  the  discussion 
on  groups.  We  will  now  introduce  a parallel  idea  for  ring  theory. 
The  distinction  being  that  the  ring  has  two  operations  and  the  group 
just  one,  so  that  the  definition  of  homomorphism  must  involve  both 
ope rations. 


Definition  58.  Let  R^  and  R2  be  two  rings.  A mapping  1(1  from  R^ 
into  R2  is  called  a homomorphism  if  for  all  a,b£R 

(i)  4>(a+b)  = 41(a)  + $ (b)  ; and 

(ii)  4>(a-b)  = 41(a)  • 4>(b). 

It  must  be  stressed  that  the  + and  • in  R^  and  R2  need  not  neces- 
sarily be  the  same  operations. 


Examples 

1.  The  identity  mapping  41  (x)  = x from  the  real  numbers  onto  the  real 
numbers  is  a ring  homomorphism: 

(i)  4'(a+b)  = a+b  = 4,(a)  + 4>  (t>) » and 

(ii)  4>(a-b)  = a-b  = 4>  (a)  • 41  (b)  • 

2.  The  mapping  4>  (x)  = 5x,  however,  is  not  a ring  homomorphism.  In 
fact,  <4>  (x ) = kx,  where  k is  any  number  other  than  1 is  not  a ring 
homomorphism : 

(i)  41  (a+b)  = 5 (a+b)  = 5a  + 5b  = <p  (a)  + 4>  (b)  ; however, 

(ii)  4>(a,b)  = 5a*b  and  4*  (a)  • 41  (b)  = (5a)  • (5b)  , and  clearly 

5a-b  = 25a*b,  or  in  other  words  4>(a»b)  ? $(a)-$(b). 

3.  We  have  proven  that  the  relation,  the  remainder  upon  division  by  5, 
defined  a field  consisting  of  the  elements  [0],  [1],  [2],  [3],  and 
[4].,  If  we  consider  the  mapping  4>  (x)  = [x],  then  4 is  a ring 
homomorphism: 

(i)  4>(a+b)  = [a+b]  = [a]  + [b]  = 41(a)  + 41  (b) ; and 

(ii)  4>(a-b)  - [a*b]  = [a]  • [b]  = 4>  (a)  . 4>  (b) . 

This  example  is  an  illustration  of  the  difference  between  the 
operations  in  one  ring  and  another.  The  + in  Rj  is  normal  addi- 
tion, while  the  + in  R2  is  the  addition  of  equivalence  classes  of 

numbers.  For  instance,  27  + 16  = 43,  while  [27]  + [16]  = [43]  » [3] 
with  respect  to  the  relation  the  remainder  upon  division  by  5. 
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There  are  several  related  definitions  that  we  now  introduce. 


Definition  59.  If  <J>  is  a homomorphism  from  ring  R^  into  ring  R2, 
then  the  kernel  of  is  defined  to  be  the  set  of  all  elements  in  R^ 

such  that  <f>  applied  to  any  of  these  elements  yields  the  additive  iden- 
tity of  R2*  i.e.,  if  a is  an  element  of  the  kernel,  then  4>  (a ) = 0. 


Examples 

1.  In  the  case  of  4>  (x)  = x,  the  kernel  consists  of  only  the  element  0, 
since  every  other  element  is  mapped  onto  a nonzero  value. 

2.  In  the  example  4>  (x)  = [x],  where  [x]  represents  the  class  deter- 
mined by  the  remainder  upon  division  of  x by  5,  the  kernel  consists 
of  all  multiples  of  5.  This  is  true,  because  any  multiple  of  5 is 
mapped  into  the  class  [0],  and  [0]  is  the  additive  identity  for  the 
field  consisting  of  [0],  [1],  [2],  [3],  and  [4]. 


Definition  60.  An  isomorphism  is  a homomorphism  of  ring  R^ 
into  ring  R2  such  that  *J>  satisfies  the  additional  condition  of  being 
a 1 - 1 mapping. 


If  we  carry  the  analogy  of  rings  to  groups  one  step  further  we 
may  now  define  when  two  rings  are  isomorphic. 


Definition  61.  Rings  R^  and  R2  are  isomorphic  is  there  exists  an 
isomorphism  of  R^  onto  R2,  i.e.,  there  is  a 1 - 1 mapping  from  Rj  onto 
Rj  that  satisfies 

(i)  <J>(a+b)  = <j>  (a)  +<{>  (b)  ; and 

(ii)  (J>(a*b)  = 0(a)*<f>(b). 


The  overall  discussion  of  rings  and  fields  was  not  as  deep  as  that 
of  groups,  the  reason  being  that  the  chapter  on  groups  could  be  followed 
up  by  a rich  collection  of  explanatory  examples  from  the  behavioral  sci- 
ences. Unfortunately,  little  work  has  been  done  in  psychology  that  uses 
rings  and  fields.  Perhaps  the  difficulty  is  that  rings  and  fields  re- 
quire two  operations  and  in  addition  these  operations  are  interrelated 
by  the  distributive  properties.  It,  therefore,  stands  to  reason  that 
any  behavioral  system  that  may  be  described  by  a ring  or  field  structure 
must  be  quite  involved.  Only  after  the  full  potential  of  group  theory 
is  realized  in  the  behavioral  sciences  will  we  really  be  able  to  pass 
judgment  as  to  the  applicative  value  of  rings  and  fields. 


CHAPTER  7 


VECTOR  SPACES  AND  LINEAR  TRANSFORMATIONS 


In  this  chapter  we  introduce  another  algebraic  system.  A vector 
space  will  have  structural  similarities  to  the  other  systems  that  we 
have  examined  in  preceding  chapters , but  it  differs  from  the  other  sys- 
tems in  that  it  has  an  operation  that  is  defined  with  respect  to  a field 
whose  elements  serve  as  operators  on  the  vector  space. 

The  value  of  particular  vector  spaces  in  statistical  and  measure- 
ment analyses  of  psychological  questions  has  been  widely  recognized, 
as  may  be  indicated  by  the  fact  that  many  graduate  psychology  depart- 
ments required  students  to  have  training  in  statistics  and  measurement. 
In  these  classes  the  students  learn  techniques  and  methods  that  are 
based  on  vector  space  theory.  The  examination  of  vector  spaces  will  be 
in  two  parts.  The  first  chapter  introduces  the  concept  of  a vector 
space,  offers  examples  of  vector  spaces,  and  then  includes  a discussion 
of  linear  combinations,  linear  independence  and  dependence,  and  bases, 
that  serve  in  a sense  as  the  building  blocks,  structurally  speaking,  of 
a vector  space.  A detailed  study  of  linear  transformations  follows,  in 
which,  among  other  things,  it  is  shown  that  the  set  of  linear  transfor- 
mations is  itself  a vector  space. 

The  second  chapter  is  directed  at  the  concept  of  a matrix.  The 
matrix  is  an  excellent  concept  to  conclude  the  book  with,  because  it 
will  be  proved  that  the  set  of  matrices  may  be  used  in  defining  a group, 
or  a ring,  or  a vector  space,  or  under  certain  special  conditions,  in 
defining  a field.  This  will  serve  as  a review  of  the  key  structures 
introduced  in  the  book.  Matrices  also  are  valuable  to  discuss  because 
they  have  a wide  range  of  applications  outside  of  mathematics. 

We  now  begin  the  examination  of  vector  spaces  by  giving  a defini- 
tion of  a vector  space. 


Definition  62.  A nonempty  set  V is  called  a vector  space  over 
field,  F,  if  V under  the  operation  + satisfies  the  following  conditions: 

(i)  For  every  v,w€V,  v+w  is  also  an  element  of  V,  i.e.,  V is 
closed  under  +; 

(ii)  For  every  u,v,w  in  V,  (u+v)  + w = u + (v+w),  i.e.,  V is 
associative  under  + ; 

(iii)  There  exists  an  element  0 in  V such  that  for  every  v€  V, 
v+0  = v,  i.e. , there  exists  an  additive  identity  in  V; 
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(iv)  For  every  v£v,  there  exists  an  element  -v  in  V such  that 

v+(-v)  = 0,  i.e.,  each  element  in  V has  its  additive  inverse 
in  V;  and 

(v)  For  every  v,w€V,  v+w  = w+v,  i.e.,  V is  commutative  under  +. 

In  addition  to  (i)  through  (v) , there  is  defined  for  every  X€  F and 
v £ V,  an  element  Xv  belonging  to  V that  satisfies  the  following  four 
conditions : 


(vi) 

For 

every 

X€  F, 

vCV, 

wGV, 

X (v+w)  = Xv  + 

Xw; 

(vii) 

For 

every 

X€  F, 

6 €F, 

v ev, 

(X+6)v  = Xv  + 

Sv; 

(viii) 

For 

every 

XC  F, 

6 €F, 

VG.V, 

X (Sv)  = (X5)v; 

and 

(ix)  For  the  multiplicative  identity  of  F,  denote  it  by  1,  and 
for  any  v£V,  lv  = v. 

A few  instructive  remarks  about  the  definition  of  a vector  space 
may  prove  helpful.  Conditions  (i)  through  (v)  are  equivalent  to  saying 
that  V under  the  operation  + is  an  abelian  group.  Conditions  (vi) 
through  (ix)  relate  the  vector  space  to  a particular  field,  and  to  em- 
phasize the  connection  between  the  set  of  elements  V,  referred  to  as  a 
vector  space,  and  the  particular  field,  V is  often  called  a vector 
space  over  a field,  rather  than  just  a vector  space.  The  operation 
joining  the  elements  of  V and  those  of  F is  often  referred  to  as  the 
operation  of  scalar  multiplication.  A convention  that  will  be  adhered 
to  in  this  book  is  to  use  Greek  letters  such  as  X,  (5#  <5,  to  represent 
elements  in  the  field.  This  should  reduce  the  possible  confusion  of 
whether  a given  element  is  to  be  considered  an  element  of  V or  of  F. 


Examples 

1.  If  we  consider  V to  be  the  set  of  all  ordered  pairs  of  real  numbers, 
i.e.,  all  points  in  the  plane,  and  take  the  field  F to  be  the  real 
numbers,  then  we  may  show  that  V is  a vector  space  of  F.  We  define 
the  addition  to  be,  for  a,b,c,d  real  numbers,  (a,b)  + (c,d)  = 

(a+c,  b+d) , i.e.,  we  are  defining  the  operation  of  addition  of  or- 
dered pairs  in  terms  of  the  sums  of  the  individual  components. 
Notice,  therefore,  that  the  plus  sign  on  the  left  and  right  hand 
side  of  the  equality  has  a different  meaning.  Scalar  multiplication 
is  defined  in  the  following  manner.  For  a,b  real  numbers  and  X a 
real  number,  X(a,b)  = (Xa,  Xb) , or  in  other  words,  the  scalar  mul- 
tiple of  an  ordered  pair  is  the  multiple  of  each  coordinate.  The 
verification  that  V is  a vector  space  is  a simple  one. 

(i)  (a,b)  + (c,d)  = (a+c,  b+d),  which  is  another  point  in  the 

plane.  Therefore,  we  have  closure. 
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(ii)  [(a,b)  + (c ,d) ] + (e,f)  = (a,b)  + [ (c,d)  + (e,f)],  because 
of  the  underlying  associativity  of  the  real  numbers. 

(iii)  The  identity  element  is  the  ordered  pair  (0,0). 

(iv)  The  additive  inverse  of  (a,b)  is  (-a,-b),  because  (a,b)  + 
(-a,-b)  = (0,0). 

(v)  The  commutative  property  is  a consequence  of  the  commuta- 
tivity of  the  real  numbers. 

(vi)  X[(a,b)  + (c,d)]  = X(a+c,  b+d)  = (X(a+c),  X (b+d) ) = 

(Xa+Xc,  Xb+Xd)  = (Xa,Xb)  + (Xc,X d)  = X(a,b)  + X(c,d). 

(vii)  (X+6) (a,b)  = ( (X+6)a, <X+6)b)  = (Xa  + 6a,  Xb  + 6b)  = 

(Xa,Xb)  + (6a, 6b)  = X(a,b)  + 6(a,b). 

(viii)  ( X 6 ) (a,b)  = (X6a,X6b)  = X(6a,  6b)  = (X)(6)(a,b). 

(ix)  l(a,b)  = (la,  lb)  = (a,b). 

Therefore,  V is  a vector  space. 

2.  For  those  readers  familiar  with  vectors,  (a,b)  would  correspond  to 
the  vector  with  x component  a and  y component  b,  emanating  from  the 
origin.  Therefore,  the  addition  of  (a,b)  and  (c,d)  is  actually  the 
operation  of  vector  addition.  Scalar  multiplication  is  the  same  as 
multiplying  a vector  by  a scalar.  This  is  indicated  graphically  in 
Figure  35.  Anyone  who  has  taken  courses  in  physics  must  realize 
the  importance  of  vectors  in  physics. 
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. Another  example  of  a vector  space  is  the  set  of  all  ordered  triples 
of  real  numbers,  i.e.,  all  points  in  3-dimensional  space,  with  the 
operations,  (a,b,c)  + (d,e,f)  = (a+d,  b+e,  c+f)  and  A(a,b,c)  = 

(Aa,  Ab,  Ac).  Three  dimensional  space  is  precisely  the  world  we 
are  a part  of.  The  verification  is  identical  to  that  in  example  1. 

4.  If  we  consider  the  set  of  functions  from  the  real  numbers  into  the 
real  numbers  to  be  V and  define  addition  by  (f+g) (x)  = f (x)  + g(x), 
for  any  real  number  x,  then  V is  an  abelian  group  under  +.  We  have 
already  shown  this  in  an  earlier  example  on  groups.  The  operation 
of  scalar  multiplication  is  defined  by  (Af) (x)  = A(f(x)),  where  A is 
an  element  of  the  field  of  real  numbers.  That  properties  (vi)  through 
(ix)  of  a vector  space  hold  is  simple  enough  to  show. 

5.  An  interesting  way  of  defining  a vector  space  is  by  considering  two 
fields  F^  and  F2 , where  F2  is  a subfield  of  Fj_.  Then  F^  is  a vector 
space  over  F2.  Clearly,  F^  is  a group  under  addition  if  Fj_  is  a 
field.  If  scalar  multiplication  is  taken  to  be  multiplication  in 
Fi,  then  the  product  of  an  element  in  F2  and  in  F^  is  certainly  in 
F^  because  F2  is  a subfield  of  Fi , and  further  multiplication  in 

F^  is  closed.  Property  (vi)  and  (vii)  correspond  to  the  distribu- 
tive laws  in  the  field,  (viii)  to  the  associative  property  for 
multiplication,  and  (ix)  to  the  existence  of  a multiplicative  iden- 
tity in  a field. 


After  introducing  concepts  such  as  a group  or  a ring,  we  followed 
by  defining  a subgroup  and  subring.  We  have  a corresponding  term  in 
the  algebraic  system  called  a vector  space. 

Definition  63.  A subspace  S of  a vector  space  V over  field  F is  a 
subset  of  V,  that  itself  is  a vector  space  under  the  operations  of  V. 

In  actuality  it  is  only  necessary  to  prove  that  S is  closed  under 
addition  and  that  for  A^F  and  vC  S,  Av€S.  The  other  properties  of  a 
vector  space  are  consequences  of  these.  For  example,  (vi)  through  (viii) 
hold  in  S because  they  already  hold  in  the  larger  set  V.  Similarly, 

(ix)  holds  because  we  are  considering  the  same  field  F,  and,  thus,  the 
same  multiplicative  identity.  Further,  if  S is  closed  under  addition, 
we  need  to  only  prove  that  the  additive  inverse  also  belongs  to  S,  in 
order  to  prove  that  S is  a subgroup  of  V under  addition.  But,  if  v€  S, 
then  -v  = (-l)v  is  also  an  element  of  S by  the  scalar  multiplication. 
Therefore,  we  have  an  alternative  way  of  proving  a set  to  be  a subspace. 

Theorem.  S is  a subspace  of  V a vector  space  if  S is  a subset  of 

V and 

(i)  if  for  v,w£S,  v+w€S;  and 

(ii)  if  vfS  and  AfcF  imply  AvCS. 
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Example 

1.  We  proved  that  the  set  of  all  functions  from  the  real  numbers  into 
the  real  numbers  may  be  defined  to  be  a vector  space  over  the  real 
numbers.  If  we  take  a subset,  namely  all  the  continuous  functions 
from  the  real  numbers  into  the  real  numbers,  then  we  have  a sub- 
space. This  follows  because  the  sum  of  two  continuous  functions 
is  a continuous  function,  which  means  additive  closure.  Scalar 
multiplication  of  a continuous  function  is  again  a continuous 
function. 


We  shift  gears  a bit  now  and  rather  than  discussing  the  structure 
called  a vector  space,  try  to  describe  how  this  structure  is  built  up. 

In  a vector  space,  a series  of  elements  are  often  added,  and  by 
the  closure  property  these  sums  yield  new  elements.  Sums  of  this  type 
have  a particular  name. 

Definition  64.  Let  v^, • • • ,Vfj  be  elements  of  a vector  space  V and 
suppose  belong  to  the  field  F,  then  an  element  X]V^+X2V2+ 

'••+XNvN  is  called  a linear  combination  of  v^ ,v2 , • • • ,vN. 

If  we  form  all  the  possible  combinations  of  the  elements 
V1,V2'""'VN'  we  form  a new  set* 

Definition  65.  If  v1,V2>*,,,vN  are  elements  of  a vector  space  V, 
then  the  linear  span  of  vi»"'»vn  is  the  set  of  all  possible  linear 
combinations  of  v^,--«,vN.  If  {vj,*»-,vN)  is  such  that  its  span  ex- 
hausts all  the  vector  space  V,  i.e.,  every  element  in  V is  expressible 
as  a linear  combination  of  v^,***,vN,  then  {v^,-*-,vN}  spans  V. 

If  we  can  find  a subset  of  V that  spans  V,  then  we  are  able  to 
describe  all  of  V by  means  of  the  information  gained  from  a subset  of 
V.  This  is  certainly  economical  in  terms  of  time  and  effort  in  study- 
ing the  set  V.  But,  we  are  not  content  at  this  even;  we  are  greedy 
enough  to  ask  if  we  can  find  an  even  smaller  set  that  will  give  us  as 
much  information.  Perhaps  there  is  still  some  built-in  redundancy  of 
information.  Keep  in  mind  that  the  question  we  are  asking  is  really 
the  one  we  are  posing  in  cognition.  How  does  one  utilize  what  he  knows 
in  learning  something  new?  We  will  offer  an  analysis  of  cognition  in 
a later  section. 

As  a step  in  the  direction  of  answering  whether  there  is  still  re- 
dundancy in  the  information  we  learn  from  a spanning  set , we  introduce 
the  important  concepts  of  linear  independence  and  dependence. 
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Definition  66.  A set  v^,V2,--*,v^  in  a sector  space  V is  said 
to  be  linearly  dependent  if  there  exist  elements  Xj_,***,Xn  in  the 
field  F,  some  of  which  are  not  zero,  such  that  Xiv^+X2V2+- • • +XnvN  = °* 

Definition  67.  A set  in  a vector  space  V is  said  to  be 

linearly  independent  if  they  are  not  linearly  dependent,  or  equivalently 
if  for  *i*X2,'-'**n  in  the  field  F,  X1v1+- • -+XNvN  = 0 implies  that 

= x2  = • ’ * = xN  = 0. 

We  will  state  a number  of  theorems  that  show  how  independence  and 
dependence  of  a set  of  vectors  reveal  information  about  the  structure 
of  a fector  space,  but  first  we  include  a few  examples  to  clarify  the 
abstract  sounding  definitions. 


Examples 

1.  We  have  proved  that  the  set  of  all  ordered  pairs  may  be  made  into  a 
vector  space.  Suppose  v3  = (1,0)  and  v2  = (0,1),  we  will  show  that 
v^  and  v2  are  linearly  independent.  Let  X^  and  X2  be  real  numbers, 
and  suppose  XjV3  + X2v2  = 0,  i.e.,  X^(1,0)  + X2(0,1)  = (X3,0)  + 

(0,X2)  = (X3,X2)  = (0,0),  since  (0,0)  is  the  zero  element.  There- 
fore, if  (X^,X2)  = (0,0),  we  must  have  X3  = X2  = 0,  which  by  defini- 
tion means  that  v^  and  v2  are  linearly  independent. 

2.  Suppose  v 3 = (2,5),  v2  = (1,-2)  and  v3  = (4,4),  and  let  X^»  X2 , 
and  X,  be  real  numbers.  If  ^ivx+^2v2+^3v3  = 0 • or  equivalently, 
X1(2,5)  + X2  (1,-2)  + X3(4,4)  = (0,0),  then  (2X1,5X1)  + (X2 ,-2>  2)  + 
(4X^,4X3)  = (0,0),  and  finally,  (2X3+X2+4X3,  5X3~2X2+4X3)  = (0,0). 
Notice,  that  if  for  example,  X^  = 4,  X2  = 4 and  X3  = -3,  we  have 
that  (2X3+X2+4\3,  5X1-2X2+4X3)  = (8  + 4 -12,  20  -8  -12)  = (0,0), 
but  this  means  that  there  exist  X3,X2,X3  not  all  zero,  such  that 
^1V1+^2V2+^3V3  = Therefore,  v. ,v2,  and  v3  are  linearly  dependent. 


We  give  the  following  theorems  without  proof,  but  we  want  some  of 
these  results  to  be  at  the  reader's  disposal. 


Theorem.  A set  vx'v2*'"*,vN  in  a vector  space  V is  linearly  de- 
pendent if  any  one  of  the  following  conditions  is  met: 

(i)  The  set  includes  the  zero  vector; 

(ii)  The  set  contains  a nonempty  subset  that  is  linearly  depen- 
dent ; or 

(iii)  There  exists  at  least  one  element,  say  vif  that  is  expressi- 
ble as  a linear  combination  of  the  remaining  elements. 
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We  do  not  include  any  proofs,  but  the  reader  is  invited  to  con- 
vince himself  that  these  statements  are  true.  For  instance,  suppose 
one  of  the  elements,  say  v^  is  the  zero  element.  Then  it  is  possible 
to  find  a linear  combination  of  v^j-'-.vjj  that  equals  zero,  but  has  at 
least  one  X not  equal  to  zero.  An  obvious  choice  would  be  XjVl+***+ 
lvi+. . .+X(jV(j  = 0.  Since  v^  = 0,  any  nonzero  X^  may  be  selected,  be- 
cause whatever  value  is  chosen  for  X^,  XjV^  = 0.  Thus,  it  is  not 
necessarily  the  case  that  X^  = X2  = • • • = XN  = 0.  Therefore, 
vl»  * ‘ • »vn  are  linearly  dependent. 


Theorem . If  a set  v^,*'*,vN  of  elements  in  a vector  space  V over 
F is  linearly  independent,  then  every  linear  combination  of  v^,***,vN 
has  a unique  representation  of  the  form  X^v^+- • -+XNvN. 

It  may  be  proved  that  if  the  representation  were  assumed  to  be  not 
unique,  then  the  independence  of  vlf...,vN  would  be  contradicted. 

We  have  introduced  two  new  concepts,  the  idea  of  a linear  combina- 
tion and  spanning  set,  and  then  the  idea  of  independence  and  dependence. 
A spanning  set  was  capable  of  accounting  for  the  entire  vector  space 
from  some  subset  of  the  space.  But  the  question  remained  as  to  whether 
an  even  smaller  set  could  be  found  that  still  spanned  all  of  the  vector 
space  V.  The  examination  of  linear  independence  offered  a way  to  remove 
redundancy  or  duplication.  If  the  set  was  dependent,  then  certain  ele- 
ments were  expressible  as  linear  combinations  of  the  others,  so  in  ef- 
fect these  elements  offer  no  information  that  could  not  have  been  ob- 
tained by  other  means  without  them.  It  would  be  wonderful  if  a set 
could  be  found  that  spans  all  of  V and  at  the  same  time  is  as  small  as 
possible  in  terms  of  the  number  of  elements  in  it.  Well,  such  a set 
exists,  and  is  called  a basis. 


Definition  68.  A vector  space  V is  of  finite  dimension  if  it  has 
a spanning  set  with  a finite  number  of  elements. 


Definition  69.  A subset  B of  a vector  space  V of  finite  dimen- 
sion is  called  a basis  for  V if  B spans  all  of  V and  B is  a linearly 
independent  set. 


Examples 

1.  We  earlier  proved  that  v^  = (1,0)  and  v2  = (0,1)  was  a linearly 
independent  set  in  the  plane.  The  set  consisting  of  v^,v2  also 
spans  the  plane,  since  for  any  point  (x,y)  in  the  plane  (x,y)  = 
x(l,0)  + y(0,l).  Therefore,  (1,0)  and  (0,1)  form  a basis  for  the 
plane. 
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2. 


As  you  might  guess  (1,0,0) , (0,1,0) , and  (0,0,1)  form  a basis  for 
three-dimensional  space.  The  set  consisting  of  (6,0,0),  (0,~5,0), 
and  (0,0, 1/2)  would  be  another  basis  for  three-dimensional  space. 

A particular  vector  space  V may  have  more  than  one  basis,  but  any 
two  bases  for  V must  have  the  same  number  of  vectors. 


Definition  70.  The  number  of  elements  in  a basis  for  a vector 
space  V is  called  the  dimension  of  V. 

We  have  accomplished  our  original  goal  of  finding  from  a spanning 
set  for  a vector  space  V a smaller  set  of  minimum  size  that  still  spans 
V.  This  set  is  the  basis,  or  perhaps  better  stated,  a basis  for  V. 

An  interesting  application  of  these  terms  is  in  the  area  of  cogni- 
tion. Suppose  that  there  is  a set  of  information  from  some  subject 
matter  that  must  be  learned.  At  first  the  student  has  no  idea  of  which 
are  the  relevant  and  irrelevant  dimensions  relating  to  the  task.  He 
has  a certain  body  of  knowledge  that  he  draws  from  in  various  combina- 
tions to  learn  individual  items.  As  he  gains  a greater  understanding 
of  the  task  he  is  considering,  he  begins  to  integrate  the  learning  of 
individual  items  into  a more  cohesive  and  structured  approach.  By 
learning  a specific  rule,  he  may  be  able  to  master  an  entire  class  of 
items  without  mastering  each  item  individually.  The  goal  of  learning 
a particular  subject  matter  may  then  be  described  as  the  process  of 
tending  towards  a cognitive  basis  capable  of  understanding  any  question 
in  the  given  area,  but  at  the  same  time  free  of  any  unnecessary  overlap 
or  redundancy. 

One  of  the  most  important  concepts  that  we  have  examined  in  previous 
chapters  is  that  of  a homomorphism.  There  is  an  analogous  concept  for 
vector  spaces,  but  it  is  called  a linear  transformation. 


Definition  71.  Let  V and  W be  vector  spaces  over  a field  F,  then 
a mapping  T from  V into  W is  called  a linear  transformation  if 

(i)  for  vi,V2€v,  T(v^+V2)  = T(v^)  + T(v2>;  and 

(ii)  for  vCV  and  ACF,  T(Av)  = AT(v). 

We  will  denote  the  set  of  all  linear  transformations  from  V into 
W by  LT(V,W) . 


Examples 

1.  An  obvious  example  is  if  V = W and  T is  defined  by  T(x)  = 5x,  then 

(i)  TtVj^+Vj)  - 5 (v^+v2)  “ 5vx  + 5v2  = T (v^)  + T(v2)  j and 
(ii)  T ( Xv)  - 5 ( Av)  - A (5v)  = AT  (v) . 
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A more  involved  example  requires  us  to  make  a few  assumptions. 

Let  the  field  be  the  real  numbers  and  let  Fix)  denote  the  set  of 

2 k 

all  polynomials  f,  where  f - Xrt+X,x+X.,x  +•  • *+Xvx  , and  the  A's  are 


'0'  "l'""  2 . 

real  numbers.  It  may  be  shown  that  Fix  | is  a vector  space.  De- 
fine an  operator  D on  f,  such  that  Df  - Xj+2X2x+*  • •+k\j{x*c~^.  For 
those  readers  who  have  had  an  introductory  calculus  course,  you 
might  realize  that  D is  the  derivative.  We  will  verify  that  D 
is  a linear  transformation.  If  f “ *o+^lx+*2x^+* • '+^kx*  and  q ■ 
60+lSlx+52x‘:  + * • •+‘‘ikxk*  then  Df  - X1+2X2x+. . . +kXJlxk“1  and  Dg  - 
5l+262x+ . . . +k(S^xk_l , so  Df  + Dg  “ (X^+OS^)  + 2(X2+62)x  + •••  + 
k (X^+6^) xk_l- . On  the  other  hand,  f+g  " + ^i+l,ii)x  + ••••< 

(Xk^k)xk,  which  implies  that  D(f+g)  » (Xj+S^)  + 2 (X2+iS2) +. . . 
k(X.  +^k)xk-1.  Therefore,  d(f+g)  - Df  + Dg,  and  similarly  it  may 
be  demonstrated  that  d(6f)  • 6 (Df ) . 


An  interesting  point  about  the  set  of  all  linear  transformations 
from  V into  W,  whore  V and  W are  vector  spaces,  is  that  LT(V,W)  is  it- 
self a vector  space. 


Theorem.  Let  V and  W be  vector  spaces  over  a field  F,  then 
LT (V , w)  is  a vector  space  over  F,  if  the  operations  are  defined  by 

(i)  for  S,TC  LT(V,W),  (S+T) (v)  - S(v)  + T(v),  where  vf  V;  and 
(ii)  for  SC  LT (V , W)  , (XS) (v)  » X(S(v)),  where  X€F  and  v{V. 

We  will  not  give  a detailed  proof,  but  will  sketch  some  of  the  im- 
portant arguments.  In  order  to  prove  that  LT(V,W)  is  a vector  space, 
we  must  show  that  if  S and  T belong  to  LT(V,W),  then  S+T  also  is  an  ele- 
ment. In  other  words,  it  is  necessary  to  prove  that  (S+T) (vj+V2>  “ 

(S+T) (v^)  + (S+T) (v2)  and  that  (S+T) (Xv)  - X(S+T)(v).  This  would  es- 
tablish closure.  The  remaining  properties  with  respect  to  the  operation 
of  addition  are  rather  elementary.  The  only  more  complicated  step  re- 
maining is  to  prove  that  if  S belongs  to  LT(V,W),  then  XS  is  also  in 
LT (V, W) . In  other  words,  XS(v^+v2)  - XS(v^)  + XS(V2)  and  XS(iSv)  - 
6 (XS) (v) . 

One  of  the  most  impressive  qualities  of  algebraic  systems  is  how 
they  all  are  nicely  interconnected.  Each  structure  builds  upon  the 
others.  We  have  defined  vector  spaces , and  now  have  just  demonstrated 
that  the  set  of  linear  transformations  from  one  vector  space  V into 
another  W is  itself  a vector  space.  If  the  vector  spaces  V and  W are 
the  same,  i.e. , V - W,  then  a new  operation  between  linear  transforma- 
tions may  be  introduced,  namely  the  product  of  two  linear  transformations 
ST.  The  product  transformation  ST  is  another  linear  transformation. 
Therefore,  LT(V,V)  has  both  an  addition  and  a multiplication  operation. 

If  you  are  thinking  "Could  LT(V,V)  be  made  into  a ring?",  the  answer 
is  yes. 


95 


Theorem.  Let  V be  a vector  space  over  a field  F,  and  LT(V,V)  be 
the  set  of  all  linear  transformations  of  V into  itself,  then  LT(V,V) 
under  the  operations  of  addition  and  multiplication  is  a ring. 

While  we  still  have  LT(V,V)  under  consideration  it  is  a good  idea 
to  introduce  a few  more  terms. 


Definition  72.  A linear  transformation  T in  LT(V,V)  is  called 
regular  or  invertible  if  there  exists  another  transformation,  denote 
it  be  T“l,  such  that  TT“1  - T_*T  - I,  where  I is  the  identity  trans- 
formation. If  no  such  transformation  exists,  then  T is  called 
singular. 


The  linear  transformation  T maps  V into  itself.  It  may  be  impor- 
tant in  some  cases  to  know  just  how  much  of  V is  mapped  into  by  T. 


Definition  73.  If  TCLT(V,V),  then  the  range  of  T is  denoted  by 
TV,  and  is  the  set  of  all  elements  in  V that  are  mapped  into  by  T. 


One  way  of  comparing  V and  the  range  of  T is  by  examining  the  basis 
for  the  range  to  see  if  it  has  fewer  elements. 


Definition  74.  For  a finite  dimensional  vector  space  V,  the  rank 
of  V is  the  number  of  elements  in  the  basis  of  the  range  of  V.  That 
is,  the  rank  is  the  dimension  of  the  range. 


The  next  chapter  will  begin  where  this  one  leaves  off.  A connec- 
tion will  be  established  between  linear  transformations  and  matrices. 
Most  of  the  terminology  of  chapter  7 is  needed  in  the  development  of 
the  chapter  on  matrices.  Once  the  connection  is  clear,  an  examination 
of  matrix  operations  is  included  in  order  to  better  understand  the 
techniques  applied  in  the  various  psychological  illustrations. 
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CHAPTER  8 


■:  I 

MATRICES  AND  THEIR  APPLICATIONS 


The  final  chapter  concerns  itself  with  the  study  of  matrices. 

The  transition  between  linear  transformations  and  matrices  is  a smooth 
one,  because  a matrix  will  be  defined  in  terms  of  a linear  transforma- 
tion’s action  on  a basis  of  a vector  space  V.  The  action  of  the  trans- 
formation on  any  particular  basis  element  will  be  expressible  as  a 
linear  combination  of  the  basis  elements  of  a vector  space  W.  Having 
defined  a matrix  it  will  be  necessary  to  examine  its  structure,  and 
in  due  course  we  will  be  able  to  form  a group  of  matrices,  a vector 
space  of  matrices,  a ring  of  matrices,  and  with  special  consideration, 
a field  of  matrices.  We  will  then  shift  our  emphasis  from  theory  to 
application,  and  study  how  matrices  make  many  types  of  statistical 
analyses  tolerable. 

Let  T be  a linear  transformation  from  a vector  space  V into  a 
vector  space  W,  i.e.,  T«LT(V,W).  Suppose  that  V is  of  dimension  n 
ami  that  W is  of  dimension  m,  and  that  v1,v2,**-,vn  and  wj , , • . . ,wm, 
are  bases  of  V and  W respectively.  Further,  assume  that  both  V and  W 
are  defined  over  the  same  field  of  F.  If  we  know  how  T acts  on  a basis 
of  V,  then  in  effect  we  know  how  T acts  on  any  element  in  V,  since  every 
element  in  V is  a linear  combination  of  v^ ,v2 , • • • ,vn. 

Let  the  action  of  T on  vi,v2,-..,vn  be  described  as  follows: 


T(v1) 

T(v2) 


ailWl  + “12W2  + 


a21Wl  + a22W2  + 


+ a,  w 
lm  m 


+ w 
2m  m 


T (v  ) 
n 


« ,w  + a _,w„  + 
nl  1 n2  2 


+ a w 
nm  m 


That  is,  T maps  an  element  of  V into  an  element  of  W,  and  any  element 
in  W is  expressible  as  a linear  combination  of  w^...^,  the  basis  of 
W.  The  are  elements  of  the  field  F.  The  double  subscript  is  used 
to  locate  the  particular  entry.  The  first  subscript  indicates  what  row 
the  element  is  in.  For  example,  if  it  was  a 4,  this  means  we  are  in 
the  4th  row  from  the  top.  The  second  subscript  indicates  the  column 
under  consideration.  This  means  that  the  7th  column,  for  instance, 
would  be  the  7th  column  over  from  the  left.  So,  would  be  the  ele- 
ment in  the  4th  row  and  the  7th  column. 
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There  are  n rows  and  m columns  in  our  system  of  equations.  The 
array  of  . elements  completely  describes  the  action  of  the  linear 
transformation  T.  The  rectangular  array  of  the  a^j  is  called  a matrix. 

Definition  75.  Let  V and  W be  vector  spaces  over  F of  dimensions 
n and  m,  respectively,  and  assume  that  vi»V2»«--*vn  is  a basis  for  V 
and  #w2 * • • • 'wm  a for  w*  Let  T be  a linear  transformation 

of  V into  W,  the  matrix  of  T with  respect  to  the  given  bases  is 


°11 

ai2* 

a21 

a22* 

01 

31 

32 

• • • 

a . 

• • • 

a 

nl 

n2 

where  T(vi)  = aHwl  + <*i2w2  + •••  + aimwm'  ^or  each  i»  1 < i < n.  The 
matrix  is  an  n x m matrix. 

Before  we  go  any  further,  a less  abstract  illustration  of  the  defi- 
nition of  a matrix  may  be  helpful.  If  we  have. 


T (v  ) = 7w,  - 3w_  + w - w, 
L 12  3 4 


T(v2)  = Wj^ 


+ 5w  - 4w 
3 4 


T(v3>  = 2w3  + w2  “ w3 


then  the  matrix  of  T would  be 


7-3  1-1 

10  5-4 

2 1-10 


We  will  be  most  interested  in  the  structure  of  square  matrices, 
i.e.,  matrices  having  the  same  number  of  rows  and  columns.  In  fact,  the 
study  of  transformations  T from  a vector  space  V into  itself  will  prove 
to  be  of  the  most  theoretical  value. 
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Suppose  that  T is  a linear  transformation  of  a vector  space  V 
into  itself.  Let  V be  an  n dimensional  vector  space  with  basis 
v^,...,vn,  and  define  the  action  of  T on  V by 


Ttv^ 

T(v2) 


aiivi  ♦ anv->  + •••  + a,  v 
11  1 12  2 In  n 


a„v,  + a v + ...  + a.  v 
21  1 22  2 2n  n 


T(v  ) - a ,v, 
n nl  1 


+ an2V2  + 


a v 
nn  n 


Then  the  matrix  associated  with  this  sytem  would  be  the  following: 


r 

ii 

al2  * 

• • • (1. 

In 

“21 

“22  * 

• • • 0l« 

2n 

anl 

u 

an2  * 

• • • a 

nn 

which  is  an  n x n matrix. 

To  ask  what  the  matrix  for  a particular  linear  transformation  looks 
like  is  an  ambiguous  question  unless  the  basis  of  the  vector  space  is 
specified.  Suppose  T is  a mapping  from  a vector  space  V into  V,  and 
let  U be  the  set  of  all  ordered  pairs  of  real  numbers,  i.e.,  the  Car- 
tesian plane.  Also  assume  that  the  field  is  the  field  of  real  numbers. 

A basis  for  V would  be  Vj  ■ (1,0)  and  v,  - (0,1).  If  the  linear  trans- 
formation T is  defined  by  T(vj)  ■ vj  and  T(V2)  ” vj,  then  the  matrix 
of  T with  respect  to  this  basis  is 


Another  basis  for  V would  be  w^  * (1,1)  and  W2  - (1,-1).  It  would  be 
good  practice  to  verify  that  w^  and  W2  are  independent  and  that  they 
span  all  of  V.  We  may  describe  the  action  of  T on  this  basis  as  well. 

T(w^)  ■ T(vj+V2),  because  wj  - V]+V2,  since  (1,1)  - (1,0)  (0,1). 

But  since  T is  a linear  transformation,  T(w^)  - T(v1+V2>  « T(v^) 

T(V2>  ■ V2  ♦ v^  • vj  + V2  ■ w^.  Similarly,  T(W2)  “ T(vj  - V2) , because 
w2  " V1  “ v2*  ®nd  further,  T(wj)  ■ T(v^  - V2)  ■ Ttvj)  - T(v2)  * 
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v2  “ V1  * "(vi_V2>  ■ -W2*  Therefore,  the  matrix  of  T with  respect  to 
this  basis  is 


Clearly,  the  two  matrices  are  different,  even  though  both  are  for  the 
same  linear  transformation.  This  is  why  it  is  so  inf>ortant  to  know 
what  the  basis  for  the  vector  space  is. 

Having  established  what  a matrix  is,  and  how  it  ties  in  with  the 
theory  of  vector  spaces,  it  would  be  fruitful  to  examine  various  opera- 
tions on  matrices.  For  example,  what  is  the  sum  of  two  matrices?  In 
order  to  be  able  to  add. two  matrices,  they  must  be  of  the  same  size, 
that  is,  a 3 x 3 matrix  cannot  be  added  toa4x4ora3x5  matrix, 
but  only  with  another  3x3  matrix.  Suppose  we  have  two  n x m matrices 


^all 

aim^ 

| 

r\i 

a21 

a2m 
• • 

• • 

and 

1*21 

Y2« 

• • 

• • 

IV 

• • 

a 

nm 

J 

Ynl 

a • 

Ynm 

For  simplicity  we  will  denote  them  by  [a^]  and  ( j 1 respectively. 

Definition  76.  If  [a$j]  and  [y,.]  are  two  n x m matrices,  then 
the  sum  of  [oi^ . ] and  [y^j]  Is  the  matrix  obtained  by  adding  their  cor- 
responding elements.  Therefore,  fa^j]  + [Yij]  * ^aij+YijJ»  or 


Examples 


n 

5 

0 

r 

f° 

0 

4 

0 

^2+0 

5+0 

0+4 

1+6^ 

3 

-2 

7 

2 

3 

2 

1 

5 

3+3 

-2+2 

7+1 

2+5 

+ 

- 

4 

1 

5 

3 

0 

4 

-2 

-3 

4+0 

1+4 

5-2 

3-3 

2 

0 

-4 

-1 

3 

-1 

-5 

6 

2+3 

0-1 

-4-5 

-1+6 

V 

> 

J 

L 

J 

G 

5 

4 

7 ^ 

6 

0 

8 

7 

4 

5 

3 

0 

J5 

-1 

-9 

r 

i 

2 

f2 

2 

2^ 

p 

4 

5 

4 

5 

6 

+ 

4 

4 

4 

3 

8 

9 

10 

• 

,7 

8 

9 

-3 

-3 

-3 

4 

5 

6 

\ 

J 

J 

If  we  consider  the  set  of  all  n x m matrices  together  with  the  opera- 
tion of  matrix  addition,  this  set  forms  a group.  This  is  what  makes 
the  study  of  mathematical  systems  so  nice;  they  have  a way  of  becoming 
interwoven. 


Theorem.  If  is  the  set  of  all  n x m matrices  whose  matrices  have 
real  number  entries,  and  if  the  operation  is  matrix  addition,  then  A\ is 
an  abelian  group. 

Proof  s 


(i)  Closure  follows  directly  from  the  definition,  since  the  sum 
of  two  n x m matrices  with  real  elements  in  another  n x m 
matrix  with  real  elements. 


(ii) 


The  associativity  is  a consequence  of  the  definition  of 
dition  and  the  associativity  of  the  real  numbers.  Each 
will  have  an  equality  between  expressions  of  the  type 


(aij+Yij} 


+ e 


- a. 


ij  ij 


(W- 


ad- 

entry 


(iii)  The  identity  element  is  the  matrix,  all  of  whose  elements 
are  0,  i.e., 


I 
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Therefore,  'v\  is  a group. 

(v)  The  comnutative  property  holds  because  it  holds  for  the  real 
numbers,  and,  therefore,  o^.  + y.  . - Yi,  + o^.  for  each  ele- 
ment in  the  matrices.  Hence, is  an  abelian  group. 

Another  operation  that  we  have  examined  in  the  last  chapter  is 
that  of  scalar  multiplication. 
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Definition  77.  If  [a^]  is  an  n x m matrix  whose  entries  are  real 
numbers  and  if  X is  a real  number,  then  the  scalar  product  of  X and  the 
matrix,  denoted  by  Xla^j)  is  tha,.  matrix  whose  entries  are  obtained  by 
multiplying  each  entry  of  [a^j]  by  X.  In  other  words. 


Examples 


By  forming  a system  consisting  of  the  set  of  all  n x m matrices 
with  real  entries,/^,  and  the  two  operations  of  matrix  addition  and 
scalar  multiplication,  we  have  a vector  space. 

Theorem.  If W consists  of  all  the  n x m matrices  with  real  number 
entries,  and  there  are  two  operations,  matrix  addition  and  scalar  multi- 
plication, defined  onAl,  then  M is  a vector  space. 

Proof:  We  have  already  shown  that M under  matrix  addition  is  a 
commutative  group.  Also  A[a^j]  is  a well  defined  operation  that  yields 
another  element  in  M . Therefore,  only  conditions  (vi)  - (ix)  of  a 
vector  space  must  be  substantiated. 

To  verify  that  property  (vi)  is  valid,  we  must  show 
that  X ( [ai_j  ] + [ Yi;.  ] > = + My^]* 
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rlm  ^ 


X(I°,ijl  + (Yij])  " X 


< i.  I JL 


zm  2m 


(Jnl  + Ynl  ‘ 

• * * 

°nm  + Ynm^J 

X(all+Yll)  • • 

* X(alm+Ylm^ 

Sl%  • 

. . .Aa,  +Ay,  ~N 
lm  lm 

X(a21+Y21)  * * 

* X(a2m+Y2m) 

ss 

X(anl+Ynl)  * * 

. A (a  +y  ) 
nm  nm  ^ 

Aa  +Ay  , . 
nl  'nl 

. . .Aa  +Ay 

nm  nm 

J 

11 


. Aa, 
lm 


i *a  i 

'v  nl 


Aa 


nm 


C\ 


Ay^^  ....  Ay 


*Y 


nl 


lm 


. .Ay 


nm 


Properties  (vii)  and  (viii)  may  be  verified  in  a manner  analogous 
to  that  above.  Property  (ix) , l[a..l  = [a..l,  holds  because 


Therefore , ^ is  a vector  space. 


Before  going  any  further  it  would  be  advisable  to  formally  define 
what  may  already  be  intuitively  clear. 


equal 


Definition  78.  Two  matrices  [a^j]  and  [y^j], 
■_  if  and  only  if  all  their  corresponding  entri 


es  [ «£ j ] and  [Yij]»  both  n x m,  are 
corresponding  entries  are  equal. 


Therefore,  even  though  the  following  two  matrices  are  very  similar 
they  are  not  equal. 


3 2 1 


8 2-5 


3 2 1 


8 2-5 


5-14  and  5 2 4 differ  only  in  the  <*22  position. 


Another  important  term  in  matrix  theory  is  that  of  the  transpose 
of  a matrix. 


Definition  79.  Let  ] be  an  n x m matrix,  then  the  transpose 
of  laijl'  denoted  by  l j ] ^ » is  the  m x n matrix  obtained  by  interchang- 
ing the  rows  and  columns  of  [a^].  In  other  words,  the  rows  of  [a,.] 
are  tl^e  columns  of  and  the  columns  of  [a^j]  are  the  rows  of13 

fa,  . 1 
ID 

The  operation  of  matrix  multiplication  is  more  complicated  than 
matrix  addition  or  scalar  multiplication.  It  is  interesting  that  the 
two  matrices  do  not  have  to  be  of  the  same  size.  It  is  only  necessary 
that  the  number  of  columns  of  the  first  matrix  be  the  same  as  the  number 
of  rows  of  the  second  matrix.  In  other  words,  we  may  compute  the  matrix 
product  of  an  n x m and  a m x p matrix,  but  not  the  product  of  a m x p 
and  n x m matrix. 


Definition  80.  Suppose  [a^j]  is  an  n x m matrix  and  [ ] is  an 
m x p matrix,  then  the  matrix  product  [0^]  of  [aA . ] and  [y^]  is  an 
n x p matrix,  whose  elements  are  determined  by  the3 following3 rule : 

The  entry  in  the  ij  position  is  obtained  by  multiplying  the  first  entry 
in  the  ith  row  of  [ai;j]  by  the  first  entry  in  the  jth  column  of  [yi j ] 
and  then  adding  to  it  the  product  of  the  second  entry  in  the  ith  row 
of  l°ij]  40(5  the  second  entry  of  the  jth  column  of  [Yijl»  and  so  on, 
until  the  product  of  the  mth  element  in  the  ith  row  of  [a^j ] and  the 
mth  element  of  the  jth  column.  A formula  for  this  would  be 


* “l2Y2j  * 


+ a.  y . 
in  n] 
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The  double  aubscripte  may  cause  some  readers  difficulty,  so 
Include  several  concrete  illustrations. 


1. 


Examples 


r 

5 (-4) +3 (5) 
(-1)  (-4)  +2  (5 ) 


5 (1) +3 (8) 
(-1)  (1)  +2  (8) 


The  entry  in  the  11  position  is  obtained  by 


taking  the  first  row  of  the  first  matrix  times  the  first  column  of 
the  second  matrix.  The  entry  in  the  12  position  is  obtained  by 
taking  the  first  row  of  the  first  matrix  times  the  second  column 
of  the  second  matrix,  and  so  on.  The  resultant  matrix  is  a 2 x 2 
matrix  since  it  is  the  product  of  a 2 x 2 matrix  and  a 2 x 2 matrix. 


2. 

\ 4 i 

G 

m 

^1(3) +4 (4) -2 (2) 

l(0)+4(-3)-2(-2)"^ 

V5  0 V 

r 

-3 

k5(3)+0(4)+3(2) 

5 (0) +0 (-3) +3  (-2) J 

-2 

J 

r. 


15 

GO 

1 

21 

-6 

The  product  of  a 2 x 3 and  a 3 x 2 matrix  is  a 2 x 2 matrix. 


r3 

0^ 

if1  4 

^ (1) +0 (5) 

3 (4) +0(0) 

3<-2)+0(3p 

4 

-3 

Z7 

0 

u> 

1 

4 ( 1 ) — 3 (5) 

4 (4) -3 (0) 

4 (-2) -3(3) 

2 

-2 

- 

^2(l)-2(5) 

2 (4) -2 (0) 

2 (-2) -2 (3) 

3 12  -e  \ 


- -11  16  -17  I . 

^ -8  8 -10  J 

The  product  of  a 3 x 2 and  a 2 x 3 matrix  is  a 3 x 3 matrix.  It 
is  important  to  notice  that  the  matrices  in  examples  2 and  3 are 
the  same,  but  the  order  of  multiplication  is  reversed.  The  size 
of  the  matrices  is  not  even  the  same,  one  is  2 x 2 and  the  other 
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is  3 x 3.  In  general,  the  product  of  two  matrices  is  not  commu- 
tative, that  is  the  order  of  multiplication  makes  a difference. 


4.  An  important  matrix  is  the  identity  matrix,  which  has  l's  down  the 
diagonal  from  upper  left  to  lower  right  in  a n x n matrix,  and 
every  other  entry  is  a xero.  A 3 x 3 identity  matrix  would  be 

r ^ 

10  0 

0 10 

0 0 1 
V 


It  is  called  an  identity  matrix  because,  for  example, 

r. 


2 -3 

-5  0 

1 1 

r 


1 

r 

i 

0 

(A 

0 

1 

0 

- 

0 

0 

1 

2 (1)  -3  (0)  +1  (0)  2 (0)  -3  ( 1 ) +1  (0)  2 (0)  -3  (0)  +1  (1 ) 

-5(1) +0(0) +4(0)  -5(0) +0(1) +4(0)  -5  (0) +0 (0) +4 (1 ) 

1 (1 ) +1 (0)+3  (0)  1 (0) +1 (1 ) +3  (0)  1 (0) +1 (0) +3  (1 ) 


r\ 


2 -3  A 


-5  0 

„ 1 1 


If  we  restrict  our  consideration  to  the  set  of  all  n x n matrices 
with  real  entries  and  define  the  operations  of  matrix  addition  and 
matrix  multiplication  on  it,  then  the  set  is  a ring. 


Theorem.  Let  AJbe  the  set  of  all  n x n matrices  with  real  entries, 
and  suppose  that  the  operations  of  matrix  addition  and  multiplication 
are  defined  on  then  A)  is  a ring  with  a multipli  ative  identity. 
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Proof:  We  have  already  proved  that  AA  is  an  abelian  group  under 
matrix  addition.  The  closure  of  matrices  under  matrix  multiplication 
follows  because  the  product  of  an  n x n matrix  with  another  n x n 
matrix  is  an  n x n matrix.  The  associativity  of  matrix  multiplica- 
tion requires  a great  deal  of  paperwork,  but  does  follow  directly  from 
the  definition  of  matrix  multiplication  and  the  associativity  of  the 
real  numbers.  The  distributive  law  requires  the  proof  that 

laijl((Yij)  + (0i-j])  “ (aijllYii)  ♦ Iaii)(0ij]*  This,  too,  is  a rather 
lengthy  calculation.  On  the  left  hand  side,  [y^j]  and  [O^j]  are  added, 
and  then  we  compute  the  product  of  (a^j ] and  the  matrix  we  obtained 
by  addition.  The  right  hand  side  of  the  equality  requires  the  products 
of  [a^j]  and  [Yij)»  and  («ij)  and  [ 0 ^ ^ . and  then  the  two  resultant 
matrices  are  added.  The  results  of  the  left  and  right  hand  sides  will 
be  the  same.  The  identity  element  is  the  matrix 

~\ 

0 0 ...  0 
1 0 ...  0 
0 1 ...  0 


0 

0 


^000 


The  ring  is  not  commutative. 


For 


example 
the  zero  element. 


is 


The  only  question  that  remains  is  that  of  the  multiplicative  in- 
verse of  a matrix.  To  begin  with,  only  square  matrices  possess  an 
inverse,  and  not  even  all  square  matrices  have  an  inverse.  The  usual 
approach  to  finding  the  inverse  of  a matrix  involves  the  study  of  de- 
terminants. A rather  formal  approach  to  determinants  is  very  messy 
because  of  the  great  amount  of  notation  required.  For  this  reason  the 
topic  of  determinants  will  not  be  examined  in  this  book.  However,  there 
exists  an  alternate  approach  to  finding  the  inverse  of  a matrix.  This 
procedure  involves  what  are  called  elementary  row  operations.  We  state 
these  operations  without  a thorough  description.  A matrix  may  have  a 
particular  row  multiplied  by  a nonzero  constant,  two  rows  may  be  inter- 
changed, and  the  multiple  of  one  row  may  be  added  to  another.  If  the 
n x n matrix  [ « i j ] is  altered  by  performing  a series  of  these  elementary 
row  operations  and  at  the  same  time  we  are  performing  each  one  of  these 
operations  on  the  n x n identity  matrix.  Once  our  original  n x n matrix 
has  been  altered  until  it  is  now  the  n x n identity  matrix,  whatever  the 
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r 

I 

matrix  that  was  originally  the  identity  matrix  looks  now  is  the  inverse 
of  If  If  I®  impossible  to  reduce  [ajj]  to  the  identity  matrix, 

then  has  no  inverse. 

This  entire  discussion  may  seem  incredible,  but  keep  in  mind  just 
how  complicated  it  should  be  to  find  the  inverse  of  not  one  number,  but 
an  entire  array  of  numbers. 


Example 


Let  lu^] 


We  start  with 

Now  we  add  the  second  row  to  the  first'  row  and  do  the' sai 


identity  matrix,  and  rewrite  the  first  row  as  this  sum 

A 

. Now  again,  add  the  first  and  second  rows,  but  this  time 


ri 


[:  •:)  - C: ;) 

ime  for^t 

r.:) 


for^the 

and 


rewrite  the  second  row  as  the  sum  of 
r*  — 

2 -1 

1 


A 

r 

0 

and 

1 

1 

1. 

A 

2. 

inverse  of 


should  be 


us  check: 


-nfi  l\  r2(D-i 

1 ill1  Awm 


Then  the 

Do  you  believe  it?  Let 
-1(1)  2(1)- 


[-*  *IAA  (1)+1(1)  (-1)  dt 

1 0\jl  1V2  -A  fl  (2)  + (l)  (-1)  1(-1)+1(1) 

0 1 J[l  2 J ( -1  lj  (l(2)+2<-l)  1 (-l)+2  (1) 


It  works  1 


:) 


An  amazing  result  is  that  if  we  restrict  ourselves  to  the  con- 
of  all  2x2  matrices  with  real  entries  that  are  of  the 

^ , and  we  take  the  operations  of  matrix  addition  and 

matrix  multiplication,  then  this  set  under  the  given  operations 
forms  a field.  The  reader  is  urged  to  go  through  the  verification 
that  the  set  is  closed  under  both  operations,  that  it  has  an  addi- 
tive and  multiplicative  identity,  additive  and  multiplicative  in- 
verse, and  all  the  other  required  properties. 


rati 

(“ 


side ration 
form 


Before  we  make  the  transition  from  theory  to  the  practical  and  ap- 
plied use  of  matrices,  we  show  how  matrices  are  helpful  in  solving  sys- 
tems of  equations.  We  will  give  an  illustration  for  a 2 x 2 case,  i.e., 
when  we  have  two  equations  in  two  unknowns,  but  the  method  is  technically 
the  same  for  a twenty  equation  in  twenty  unknown  systems.  Consider, 
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2x  - y - 3 
-x  + y ■ -1. 


We  could  easily  show  that  x ■ 2 and  y ■ 1 by  using  the  normal  procedures 
of  solving  simultaneous  equations.  An  alternative  procedure  uses  ma- 
trices . We  can  rewrite  the  system  of  equations  as 


-1 


f2X  ” 0 f3l 

because  this  is  the  same  as  1 I - I 1 , and  by  the  definition  of 

l-x  + y J l-i  ) 

equality  of  matrices,  2x  - y = 3 and  -x  + y ■ -1.  In  considering, 

f 2 -m(m  m p 

! I 1 I * I , if  we  could  find  the  inverse  of  1 I , 

l*1  yuJ  l-u  l-1  u 

Tv] 

l A :!■ 

t:;]' 


would  have 
could  read 

inverse  of 


we 


all  alone  on  the  left  hand  side  of  the  equality  and  we 
answer  to  the  problem.  We  have  already  computed  the 


of  the  equation  by 


Therefore,  multiply  both  sides 


f:  I.!;]-  [::)(:) 

f:  I;)  • C %) 

f;l  • f: ;]  [:) 

pA  p(3)+l(-lA 

lyj  |ki(3)+2(-i)J 
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Therefore,  we  have  that  x - 2 and  y ■ 1. 

The  applications  of  matrices  are  fairly  well  known.  The  value  of 
matrices  in  any  statistical  analysis  of  experimental  data  will  be  il- 
lustrated with  a series  of  examples.  Other  applications  will  also  be 
cited. 


Examples 


1.  The  theory  of  Markov  chains  concerns  itself  with  the  study  of  an 
experimental  situation  where  the  outcome  on  any  given  trial  de- 
pends only  on  the  outcome  of  the  immediately  preceding  trial. 
Therefore,  an  outcome  Ej  does  not  have  a fixed  probability,  but 
rather  a conditional  probability,  p^,  which  represents  the  fol- 
lowing. Given  that  outcome  E^  has  occurred,  the  probability  that 
outcome  Ej  will  occur  on  the  next  trial  is  p^.  For  example,  if 
we  have  outcomes  E^,  E^,  and  Eg  occurring  on  succession,  then  the 
probability  of  this  event  is  P1P15P59,  where  pj^  is  the  probability 
that  E^  occurs  on  the  first  trial.  The  outcomes,  Ei#  are  generally 
referred  to  as  the  states  of  the  system,  and  the  p^j  are  called 
the  transition  probabilities.  An  array  or  matrix  can  be  formed 
that  includes  all  the  transition  probabilities  in  an  experiment 
that  has  Ejy.-.jEjj  as  possible  states. 
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is  called  the  matrix  of  transition  proba- 


bilities. From  this  matrix  we  may  determine  the  probability  of 
going  from  any  state  to  any  other  state  on  the  next  trial.  A 
necessary  condition  concerning  the  rows  of  the  matrix  is  that  the 
sum  of  the  transition  probabilities  across  any  row  is  equal  to  one. 
Markov  chains  have  many  applications  in  probability,  physics,  and 
genetics.  Recently  they  have  also  been  used  in  forming  models  for 
classical  conditioning,  paired  associate  learning,  and  recall 
learning. 


2.  Theios  and  Brelsford  (1966)  have  written  an  article  concerning  the 
use  of  a Markov  model  to  describe  eye  blink  conditioning  in  rab- 
bits. They  developed  a theory  to  describe  the  changes  taking  place 
in  the  trial  by  trial  probability  of  eliciting  a response  by  the 
rabbit.  The  experiment  used  a tone  as  the  conditioned  stimulus 
(CS) , an  air  puff  to  the  eye  served  as  the  unconditioned  stimulus 
(UCS) , and  the  desired  response  was  an  eye  blink  to  the  conditioned 
stimulus.  Theios  and  Brelsford  used  the  following  Markov  model  to 
reflect  the  changes  in  the  probabilities  during  the  experiment. 

The  matrices  that  we  will  consider  are 

CAN  P p (start) 

_ r r 
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a 1-a  ^ 

UJ 

The  remaining  discussion  is  intended  to  clarify  Theios  and  Brels- 
ford's  reasoning  and  choice  of  notation.  The  rows  of  the  3x3 
transition  matrix  are  the  states  of  responsiveness  on  any  given 
trial,  while  the  columns  are  the  possible  states  on  the  next  trial. 
The  entries  in  the  matrix  are  the  probabilities  of  moving  from  the 
given  state  to  another  during  N,  the  intertrial  period.  The  first 
1x3  matrix  has  entries  representing  the  probability  of  a response 
during  the  observation  interval  for  each  of  the  three  states  of 
responsiveness.  The  second  1x3  matrix  gives  the  probabilities 
of  a rabbit  beginning  the  experiment  in  a particular  state. 

The  rabbit  begins  the  experiment  in  the  naive  state,  N,  where 
the  probability  of  a response  to  the  conditioned  stimulus  is  PN. 
After  each  application  of  the  unconditioned  stimulus  (UCS) , there 
is  a probability,  a,  that  the  rabbit  will  become  aroused.  We 
represent  this  by  saying  the  rabbit  moves  to  state  A.  Once  it  is 
activated,  the  rabbit  may  give  a response  to  the  CS.  We  denote  the 
probability  of  this  by  Pft.  After  arousal,  there  is  then  a certain 
likelihood  that  the  response  will  become  conditioned  to  the  CS. 

I^t  us  call  this  probability,  c,  and  this  represents  the  transition 
into  the  third  state,  C.  Once  conditioning  has  occurred,  there  is 
a probability  Pc  that  the  rabbit  will  respond  by  blinking  to  the  CS 
before  the  UCS  occurs.  Therefore,  there  are  actually  three  distinct 
levels  of  performance,  PN,  Pft,  and  Pc  in  a conditioning  experiment. 

3.  There  are  other  areas  in  psychology  where  Markov  models  are  being 
used.  These  models  are  valuable  in  studies  of  paired  associate 
learning,  recall  learning,  and  avoidance  conditioning,  in  the 
list  of  references  at  the  end  of  the  chapter,  a number  of  articles 
are  included  that  contain  discussions  of  these  topics. 
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We  could  express  our  system  for  estimates  a and 


Y1  ' *0  + Vl 
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Let  us  next  multiply  both  sides  of  the  equality  by  the  transpose  of 


1 X, 


1 X. 


1 X. 
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1 X, 
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which  simplifies  to 
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For  convenience,  let  us  denote  the  equality  as  x'Y  = (X^Ja.  As 
we  can  observe  X^X  is  an  example  of  a square  matrix.  It  is  a 2 x 2 
matrix.  If  we  compute  its  inverse  (X/X)“l,  then  we  can  solve  the 
system  for  a.  Therefore,  (X/X)~^X/Y  = a,  from  which  we  can  find 


those  values  for  a - 


that  give  us  the  least  square  estimates. 


Draper  and  Smith  also  use  matrices  in  the  analysis  of  variance 
and  the  variance  and  covariance  of  ag  and  a^.  The  regression  analy- 
sis may  be  shifted  to  an  examination  of  correlations  between  vari- 
ables. Correlations  are  desirable  because  their  values  range  be- 
tween -1  and  1.  In  general,  we  may  form  a matrix  of  correlations. 


rll  ri2  * ' 


r21  r22  * * 


r r 
N1  N2 


from  which  we  may  analyze  the  interdependence  of  variables. 
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7. 


A real  strength  of  the  use  of  matrices  over  other  techniques 
of  solving  systems  of  equations  is  that  the  approach  is  aene  aTL 

forTe^aUonsSinh3  ^ 3°  equations  in  30  unknowns  as  it  is 

Site  TTlt  r unknowns.  This  means  that  it  is  easier  to 

write  a computer  program  that  can  analyze  the  data. 

(CuiSoS  “1959?  Tlces  “ the  tectaiW  of  factor  analysis 
luuilrord,  1959) . A correlation  matrix  has  as  many  rows  and  col- 

“»  ther*  *«  tests  or  variables,  however,  a fL^e^rix 

Sere  a^TcoZ^  teStS'  bUt  only  as  «““*  col“»'s  “ 

c-,/™0  factors.  These  two  matrices  are  related  by  the 
equation  FF  = R/  where  R is  the  correlation  matrix,  F is  the 
factor  »atr,x,  ,„d  y/  is  the  transpose  of  the  factw  L«i,  A 

tS  raLr:fUt1LSh°"S  ?h.at  the  m”b“  °f  factors  1.  to 

l V°  0n  matrix-  In  other  words,  it  is  equal 

»tr£.  line*rl1’  ‘"^Pendent  row  in  the  c^relhtilT 


SHfir  °f  as9"°^ertransitionCfrLSthee;heSeti- 

al  to  the  applied,  and  the  applications  revealed  the  rich  potential 
of  matrices  in  questions  of  learning  and  in  data  ana^s.  P°tentlal 

m *-vi  WG  ®nd  th®  book  a few  concluding  words  may  be  in  order 

of  theoretical  mth fCi^ting  Su*ject  “ itself-  ®ere  are  thousands 

1 ™^hemticlans  who  will  attest  to  this.  But  it  is  also 

S nsvcSiLJ  rif!  lnstrument  in  structuring  and  analyzing  questions 
n psychology.  The  algebraic  systems  we  have  examined  are  n£st  worthv 
of  close  scrutiny  as  to  how  and  where  they  should  be  usS  TLthf 

^put  ^lt  3 5!Shi°n  m°de1'  ifc  looks  9°od  no  matter  what 

y u put  on  it,  but  remember  you  are  selling  the  clothes,  not  the  model. 
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